Sep 30 19:29:13 devstack cinder-volume[76429]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 30 19:29:13 devstack cinder-volume[76429]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 19:29:13 devstack cinder-volume[76429]: we strongly recommend against using it for new projects. Sep 30 19:29:13 devstack cinder-volume[76429]: If you are already using Eventlet, we recommend migrating to a different Sep 30 19:29:13 devstack cinder-volume[76429]: framework. For more detail see Sep 30 19:29:13 devstack cinder-volume[76429]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 19:29:13 devstack cinder-volume[76429]: import eventlet # noqa Sep 30 19:29:16 devstack cinder-volume[76429]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76429) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 19:29:16 devstack cinder-volume[76429]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76429) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 19:29:16 devstack cinder-volume[76429]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76429) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 19:29:17 devstack cinder-volume[76429]: INFO dbcounter [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Registered counter for database cinder Sep 30 19:29:17 devstack cinder-volume[76429]: DEBUG oslo_db.sqlalchemy.engines [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76429) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:29:17 devstack cinder-volume[76429]: DEBUG dbcounter [-] [76429] Writer thread running {{(pid=76429) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 19:29:17 devstack cinder-volume[76429]: INFO cinder.rpc [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 30 19:29:17 devstack cinder-volume[76429]: INFO cinder.rpc [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 30 19:29:17 devstack cinder-volume[76429]: DEBUG oslo_db.sqlalchemy.engines [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76429) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:29:17 devstack cinder-volume[76429]: INFO cinder.volume.manager [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Determined volume DB was empty at startup. Sep 30 19:29:17 devstack cinder-volume[76429]: DEBUG cinder.volume.manager [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76429) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 30 19:29:17 devstack cinder-volume[76429]: INFO cinder.volume.manager [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 30 19:29:17 devstack cinder-volume[76429]: WARNING stevedore.named [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 19:29:17 devstack cinder-volume[76429]: WARNING castellan.key_manager [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 19:29:17 devstack cinder-volume[76429]: WARNING cinder.keymgr.conf_key_mgr [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 19:29:17 devstack cinder-volume[76429]: DEBUG cinder.volume.drivers.lvm [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76429) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 30 19:29:17 devstack cinder-volume[76429]: DEBUG oslo_concurrency.processutils [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76429) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_concurrency.processutils [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] CMD "cinder-rtstool verify" returned: 0 in 0.423s {{(pid=76429) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_db.sqlalchemy.engines [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76429) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:29:18 devstack cinder-volume[76429]: INFO cinder.rpc [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 30 19:29:18 devstack cinder-volume[76429]: INFO cinder.rpc [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 30 19:29:18 devstack cinder-volume[76429]: WARNING stevedore.named [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 19:29:18 devstack cinder-volume[76429]: WARNING castellan.key_manager [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 19:29:18 devstack cinder-volume[76429]: INFO cinder.volume.manager [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_db.sqlalchemy.engines [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76429) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:29:18 devstack cinder-volume[76429]: INFO oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Starting 1 workers Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Started child 76585 {{(pid=76429) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Full set of CONF: {{(pid=76429) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] ******************************************************************************** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Configuration options gathered from: {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] ================================================================================ {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] allow_availability_zone_fallback = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] allow_compression_on_image_upload = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] allowed_direct_url_schemes = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] api_rate_limit = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] auth_strategy = keystone {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76585]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] az_cache_duration = 3600 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_availability_zone = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_host = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_stats_polling_interval = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backup_api_class = cinder.backup.api.API {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backup_name_template = backup-%s {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backup_use_same_host = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backup_use_temp_snapshot = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] chap_password = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] chap_username = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cinder_internal_tenant_project_id = c188480d80144ffca421484cda916122 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cinder_internal_tenant_user_id = 878b404de67b45e9b891d8f45b99bf73 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cloned_volume_same_az = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cluster = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] compression_format = gzip {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] compute_api_class = cinder.compute.nova.API {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] config_dir = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] config_source = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] control_exchange = openstack {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] debug = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] default_availability_zone = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] default_group_type = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] default_volume_type = lvmdriver-1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] disk_geometry = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] driver_client_cert = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] driver_client_cert_key = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] driver_data_namespace = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] driver_ssl_cert_path = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] driver_ssl_cert_verify = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] driver_use_ssl = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] enable_force_upload = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] enable_new_services = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] enable_unsupported_driver = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] enforce_multipath_for_image_xfer = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] filter_function = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_api_insecure = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_api_ssl_compression = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_ca_certificates_file = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_catalog_info = image:glance:publicURL {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_certfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_keyfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_num_retries = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance_request_timeout = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] goodness_function = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] graceful_shutdown_timeout = 5 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] group_api_class = cinder.group.api.API {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] host = devstack {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_compress_on_upload = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_conversion_address_space_limit = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_conversion_cpu_limit = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_conversion_disable = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_introspection_address_space_limit = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_introspection_cpu_limit = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_upload_use_cinder_backend = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_upload_use_internal_tenant = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_volume_cache_enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_volume_cache_max_count = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] image_volume_cache_max_size_gb = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] init_host_max_objects_retrieval = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] instance_format = [instance: %(uuid)s] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] iscsi_target_flags = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] iscsi_write_cache = on {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] iser_helper = tgtadm {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] iser_ip_address = 192.168.122.24 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] iser_port = 3260 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] log_color = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] log_config_append = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] log_dir = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] log_file = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] log_options = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] log_rotate_interval = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] log_rotate_interval_type = days {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] log_rotation_type = none {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] max_age = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] max_logfile_count = 30 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] max_logfile_size_mb = 200 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] max_over_subscription_ratio = 20.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] message_reap_interval = 86400 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] message_ttl = 2592000 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] migration_create_volume_timeout_secs = 300 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] monkey_patch = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] monkey_patch_modules = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] my_ip = 192.168.122.24 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] no_snapshot_gb_quota = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] num_iser_scan_tries = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] num_shell_tries = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] num_volume_device_scan_tries = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] nvmeof_conn_info_version = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] nvmet_ns_id = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] nvmet_port_id = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76585]: INFO cinder.volume.manager [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] osapi_max_limit = 1000 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] osapi_volume_ext_list = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] osapi_volume_listen_port = 8776 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] osapi_volume_use_ssl = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] osapi_volume_workers = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] per_volume_size_limit = -1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] periodic_fuzzy_delay = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] periodic_interval = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] public_endpoint = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] publish_errors = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] quota_backup_gigabytes = 1000 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] quota_backups = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] quota_gigabytes = 1000 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] quota_groups = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] quota_snapshots = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] quota_volumes = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] rate_limit_burst = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] rate_limit_except_level = CRITICAL {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] rate_limit_interval = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] reinit_driver_count = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] replication_device = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] report_discard_supported = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] report_interval = 120 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] reservation_clean_interval = 86400 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] reservation_expire = 86400 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] reserved_image_namespaces = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] reserved_percentage = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] rpc_response_timeout = 120 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] run_external_periodic_tasks = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] scst_target_driver = iscsi {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] scst_target_iqn_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_down_time = 720 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] shell_completion = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] snapshot_name_template = snapshot-%s {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] snapshot_same_host = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] split_loggers = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] state_path = /opt/stack/data/cinder {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] storage_availability_zone = nova {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] storage_protocol = iSCSI {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] syslog_log_facility = LOG_USER {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] target_helper = lioadm {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] target_ip_address = 192.168.122.24 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] target_port = 3260 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] target_protocol = iscsi {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] target_secondary_ip_addresses = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] trace_flags = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] transport_url = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] until_refresh = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] use_chap_auth = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] use_default_quota_class = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] use_journal = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] use_json = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] use_multipath_for_image_xfer = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] use_stderr = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] use_syslog = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] verify_glance_signatures = enabled {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_api_class = cinder.volume.api.API {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_backend_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_clear = zero {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_clear_ionice = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_clear_size = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_copy_bps_limit = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_dd_blocksize = 1M {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_name_template = volume-%s {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_service_inithost_offload = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volume_usage_audit_period = month {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] zoning_mode = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_concurrency.disable_process_locking = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack sudo[76589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.auth_section = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.auth_type = password {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.auth_version = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.cache = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack sudo[76589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.certfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.include_service_catalog = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.insecure = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.interface = public {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.keyfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_password = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcache_username = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.region_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.service_type = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.backend = dogpile.cache.null {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.backend_argument = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.backend_expiration_time = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.config_prefix = cache.oslo {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.debug_cache_backend = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.enable_retry_client = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.enable_socket_keepalive = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.expiration_time = 600 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.hashclient_retry_attempts = 2 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.memcache_dead_retry = 300 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.memcache_pool_maxsize = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.memcache_sasl_enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.password = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.proxies = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.redis_db = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.redis_server = localhost:6379 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.retry_attempts = 2 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.retry_delay = 0.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.socket_keepalive_count = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.socket_keepalive_idle = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.socket_keepalive_interval = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.socket_timeout = 1.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.tls_allowed_ciphers = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.tls_cafile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.tls_certfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.tls_enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.tls_keyfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cache.username = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] coordination.backend_url = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.asyncio_connection = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.asyncio_slave_connection = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.backend = sqlalchemy {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.connection = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.connection_debug = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.connection_parameters = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.connection_recycle_time = 3600 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.connection_trace = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.db_inc_retry_interval = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.db_max_retries = 20 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.db_max_retry_interval = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.db_retry_interval = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.max_overflow = 50 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.max_pool_size = 5 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.max_retries = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.mysql_wsrep_sync_wait = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.pool_timeout = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.retry_interval = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.slave_connection = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.sqlite_synchronous = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.synchronous_reader = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] database.use_db_reconnect = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_tracing.insecure = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.connection_string = messaging:// {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.es_doc_type = notification {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.es_scroll_size = 10000 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.es_scroll_time = 2m {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.filter_error_trace = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.hmac_keys = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.sentinel_service_name = mymaster {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.socket_timeout = 0.1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.trace_requests = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler.trace_sqlalchemy = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler_jaeger.process_tags = {} {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler_jaeger.service_name_prefix = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] profiler_otlp.service_name_prefix = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.enforce_new_defaults = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.policy_default_rule = default {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.policy_file = policy.yaml {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] privsep_osbrick.group = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] privsep_osbrick.helper_command = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] privsep_osbrick.user = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cinder_sys_admin.group = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cinder_sys_admin.helper_command = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] cinder_sys_admin.user = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.auth_section = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.auth_type = password {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.cafile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.certfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.collect_timing = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.insecure = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.keyfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.send_service_user_token = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.split_loggers = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.timeout = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.tls_ciphers = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] service_user.tls_min_version = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.auth_section = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.auth_type = password {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.certfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.collect_timing = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.insecure = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.keyfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.region_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.split_loggers = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.timeout = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.tls_ciphers = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] glance.tls_min_version = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.backend_availability_zone = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.chap_password = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.chap_username = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.disk_geometry = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.driver_client_cert = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.driver_client_cert_key = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.driver_data_namespace = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.driver_use_ssl = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.extra_capabilities = {} {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.filter_function = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.goodness_function = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.iscsi_target_flags = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.iscsi_write_cache = on {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.iser_helper = tgtadm {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.iser_port = 3260 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.lvm_share_target = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.lvm_type = auto {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.num_shell_tries = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.replication_device = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.report_discard_supported = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.reserved_percentage = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.target_helper = tgtadm {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.target_port = 3260 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.target_protocol = iscsi {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.trace_flags = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.unique_fqdn_network = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.use_chap_auth = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volume_backend_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volume_clear = zero {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volume_clear_ionice = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volume_clear_size = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_reports.file_event_handler = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_reports.log_dir = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.backend_host = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.chap_password = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.chap_username = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.disk_geometry = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.driver_client_cert = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.extra_capabilities = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.filter_function = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.goodness_function = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.iser_helper = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.iser_ip_address = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.iser_port = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.lvm_share_target = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.lvm_type = auto {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.num_shell_tries = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.replication_device = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.report_discard_supported = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.reserved_percentage = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.scst_target_driver = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.storage_protocol = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.target_helper = lioadm {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.target_ip_address = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.target_port = 3260 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.trace_flags = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.use_chap_auth = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volume_clear = zero {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volume_clear_size = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] lvmdriver-1.volumes_dir = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.ssl = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_notifications.driver = [] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_notifications.retry = -1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] key_manager.fixed_key = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.barbican_api_version = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.barbican_endpoint = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.barbican_endpoint_type = public {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.barbican_region_name = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.cafile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.certfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.collect_timing = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.insecure = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.keyfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.number_of_retries = 60 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.retry_delay = 1 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.send_service_user_token = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.split_loggers = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.timeout = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.tls_ciphers = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.tls_min_version = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.verify_ssl = True {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican.verify_ssl_path = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.auth_section = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.auth_type = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.cafile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.certfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.collect_timing = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.insecure = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.keyfile = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.split_loggers = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.timeout = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.tls_ciphers = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] barbican_service_user.tls_min_version = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.approle_role_id = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.approle_secret_id = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.auth_method = approle {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.auth_path = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.kv_mountpoint = secret {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.kv_path = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.kv_version = 2 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.namespace = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.root_token_id = **** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.ssl_ca_crt_file = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.timeout = 60.0 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.token_file = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.token_role = None {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.use_ssl = False {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:29:18 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] ******************************************************************************** {{(pid=76429) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 30 19:29:19 devstack sudo[76589]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:19 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:29:19 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:19 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.361s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:29:19 devstack cinder-volume[76585]: INFO cinder.brick.local_dev.lvm [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:19 devstack sudo[76792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:29:19 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:19 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG cinder.brick.local_dev.lvm [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76585) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 30 19:29:19 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:19 devstack sudo[76876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:29:19 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:20 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:20 devstack sudo[77058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:29:20 devstack sudo[77058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:20 devstack sudo[77058]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:20 devstack sudo[77173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 30 19:29:20 devstack sudo[77173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:20 devstack sudo[77173]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.281s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:20 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:20 devstack sudo[77206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:29:20 devstack sudo[77206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:21 devstack sudo[77206]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:21 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:21 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:21 devstack sudo[77221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:29:21 devstack sudo[77221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:21 devstack sudo[77221]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:21 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:21 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:21 devstack sudo[77293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:29:21 devstack sudo[77293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:21 devstack sudo[77293]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:21 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:21 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:21 devstack sudo[77302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:29:21 devstack sudo[77302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:22 devstack sudo[77302]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:22 devstack sudo[77386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:29:22 devstack sudo[77386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:22 devstack sudo[77386]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:22 devstack cinder-volume[76585]: INFO cinder.volume.drivers.lvm [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:22 devstack sudo[77390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:29:22 devstack sudo[77390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:22 devstack sudo[77390]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG cinder.volume.drivers.lvm [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Updating volume stats {{(pid=76585) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:22 devstack sudo[77399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:29:22 devstack sudo[77399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:22 devstack sudo[77399]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:22 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:22 devstack sudo[77402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:29:22 devstack sudo[77402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:23 devstack sudo[77402]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:23 devstack sudo[77405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:29:23 devstack sudo[77405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:23 devstack sudo[77405]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:23 devstack sudo[77408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:29:23 devstack sudo[77408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:23 devstack sudo[77408]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:23 devstack cinder-volume[76585]: INFO cinder.volume.driver [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Driver hasn't implemented _init_vendor_properties() Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG cinder.volume.driver [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76585) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG oslo_db.sqlalchemy.engines [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG dbcounter [-] [76585] Writer thread running {{(pid=76585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG cinder.db.api [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Building query based on filter {{(pid=76585) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3962}} Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG cinder.image.image_utils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76585) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 30 19:29:23 devstack cinder-volume[76585]: INFO cinder.keymgr.migration [None req-980d5948-38d7-4dcd-bf54-6490b5d54bc8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG cinder.volume.drivers.lvm [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Updating volume stats {{(pid=76585) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 19:29:23 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:23 devstack sudo[77411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:29:23 devstack sudo[77411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:24 devstack sudo[77411]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:24 devstack sudo[77416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:29:24 devstack sudo[77416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:24 devstack sudo[77416]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:24 devstack sudo[77419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:29:24 devstack sudo[77419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:24 devstack sudo[77419]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:24 devstack sudo[77423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:29:24 devstack sudo[77423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:24 devstack sudo[77423]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG cinder.manager [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Notifying Schedulers of capabilities ... {{(pid=76585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:29:24 devstack cinder-volume[76585]: INFO cinder.volume.manager [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Driver initialization completed successfully. Sep 30 19:29:24 devstack cinder-volume[76585]: INFO cinder.manager [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Initiating service 2 cleanup Sep 30 19:29:24 devstack cinder-volume[76585]: INFO cinder.manager [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Service 2 cleanup completed. Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG cinder.service [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Creating RPC server for service cinder-volume {{(pid=76585) start /opt/stack/cinder/cinder/service.py:231}} Sep 30 19:29:24 devstack cinder-volume[76585]: DEBUG cinder.service [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76585) start /opt/stack/cinder/cinder/service.py:237}} Sep 30 19:29:25 devstack cinder-volume[76585]: INFO cinder.volume.manager [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 30 19:29:25 devstack cinder-volume[76585]: DEBUG cinder.volume.drivers.lvm [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Updating volume stats {{(pid=76585) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 19:29:25 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:25 devstack sudo[77426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:29:25 devstack sudo[77426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:25 devstack sudo[77426]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:25 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:25 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:25 devstack sudo[77431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:29:25 devstack sudo[77431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:25 devstack sudo[77431]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:25 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:25 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:25 devstack sudo[77437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:29:25 devstack sudo[77437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:25 devstack sudo[77437]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:25 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:25 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:29:25 devstack sudo[77440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:29:25 devstack sudo[77440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:29:26 devstack sudo[77440]: pam_unix(sudo:session): session closed for user root Sep 30 19:29:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:29:26 devstack cinder-volume[76585]: INFO cinder.volume.manager [None req-e6d5226b-2fac-4720-a492-52b80513a16a None None] Driver post RPC initialization completed successfully. Sep 30 19:29:26 devstack cinder-volume[76585]: DEBUG oslo_service.periodic_task [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running periodic task VolumeManager._thread_info {{(pid=76585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:29:26 devstack cinder-volume[76585]: DEBUG cinder.volume.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] thread count: 6 {{(pid=76585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:29:26 devstack cinder-volume[76585]: DEBUG cinder.volume.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] thread info: [<_MainThread(MainThread, started 132236966658176)>, , , , , ] {{(pid=76585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:29:28 devstack cinder-volume[76429]: DEBUG dbcounter [-] [76429] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76429) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:29:36 devstack cinder-volume[76585]: DEBUG dbcounter [-] [76585] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:29:36 devstack cinder-volume[76585]: DEBUG dbcounter [-] [76585] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:30:26 devstack cinder-volume[76585]: DEBUG oslo_service.periodic_task [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:30:26 devstack cinder-volume[76585]: DEBUG cinder.volume.drivers.lvm [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Updating volume stats {{(pid=76585) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 19:30:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:30:26 devstack sudo[79379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:30:26 devstack sudo[79379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:30:26 devstack sudo[79379]: pam_unix(sudo:session): session closed for user root Sep 30 19:30:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:30:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:30:26 devstack sudo[79382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:30:26 devstack sudo[79382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:30:26 devstack sudo[79382]: pam_unix(sudo:session): session closed for user root Sep 30 19:30:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:30:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:30:26 devstack sudo[79395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:30:26 devstack sudo[79395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:30:26 devstack sudo[79395]: pam_unix(sudo:session): session closed for user root Sep 30 19:30:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:30:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:30:26 devstack sudo[79406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:30:26 devstack sudo[79406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:30:27 devstack sudo[79406]: pam_unix(sudo:session): session closed for user root Sep 30 19:30:27 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:30:27 devstack cinder-volume[76585]: DEBUG cinder.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Notifying Schedulers of capabilities ... {{(pid=76585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:30:27 devstack cinder-volume[76585]: DEBUG oslo_service.periodic_task [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running periodic task VolumeManager._thread_info {{(pid=76585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:30:27 devstack cinder-volume[76585]: DEBUG cinder.volume.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] thread count: 6 {{(pid=76585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:30:27 devstack cinder-volume[76585]: DEBUG cinder.volume.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] thread info: [<_MainThread(MainThread, started 132236966658176)>, , , , , ] {{(pid=76585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:31:26 devstack cinder-volume[76585]: DEBUG oslo_service.periodic_task [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:31:26 devstack cinder-volume[76585]: DEBUG cinder.volume.drivers.lvm [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Updating volume stats {{(pid=76585) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 19:31:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:31:26 devstack sudo[82740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:31:26 devstack sudo[82740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:31:26 devstack sudo[82740]: pam_unix(sudo:session): session closed for user root Sep 30 19:31:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:31:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:31:26 devstack sudo[82750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:31:26 devstack sudo[82750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:31:26 devstack sudo[82750]: pam_unix(sudo:session): session closed for user root Sep 30 19:31:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:31:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:31:26 devstack sudo[82753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:31:26 devstack sudo[82753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:31:26 devstack sudo[82753]: pam_unix(sudo:session): session closed for user root Sep 30 19:31:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:31:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:31:26 devstack sudo[82757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:31:26 devstack sudo[82757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:31:27 devstack sudo[82757]: pam_unix(sudo:session): session closed for user root Sep 30 19:31:27 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:31:27 devstack cinder-volume[76585]: DEBUG cinder.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Notifying Schedulers of capabilities ... {{(pid=76585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:31:27 devstack cinder-volume[76585]: DEBUG oslo_service.periodic_task [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running periodic task VolumeManager._thread_info {{(pid=76585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:31:27 devstack cinder-volume[76585]: DEBUG cinder.volume.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] thread count: 6 {{(pid=76585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:31:27 devstack cinder-volume[76585]: DEBUG cinder.volume.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] thread info: [<_MainThread(MainThread, started 132236966658176)>, , , , , ] {{(pid=76585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:31:36 devstack cinder-volume[76585]: DEBUG dbcounter [-] [76585] Writing DB stats cinder:SELECT=1 {{(pid=76585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:31:36 devstack cinder-volume[76585]: DEBUG dbcounter [-] [76585] Writing DB stats cinder:UPDATE=1 {{(pid=76585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:32:26 devstack cinder-volume[76585]: DEBUG oslo_service.periodic_task [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:32:26 devstack cinder-volume[76585]: DEBUG cinder.volume.drivers.lvm [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Updating volume stats {{(pid=76585) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 19:32:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:32:26 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:32:26 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:32:26 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Sep 30 19:32:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:32:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:32:26 devstack sudo[84815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:32:26 devstack sudo[84815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:32:26 devstack sudo[84815]: pam_unix(sudo:session): session closed for user root Sep 30 19:32:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:32:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:32:26 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:32:26 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:32:26 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Sep 30 19:32:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:32:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:32:26 devstack sudo[84824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:32:26 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:32:27 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root Sep 30 19:32:27 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:32:27 devstack cinder-volume[76585]: DEBUG cinder.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Notifying Schedulers of capabilities ... {{(pid=76585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:33:26 devstack cinder-volume[76585]: DEBUG oslo_service.periodic_task [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:33:26 devstack cinder-volume[76585]: DEBUG cinder.volume.drivers.lvm [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Updating volume stats {{(pid=76585) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 19:33:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:33:26 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 19:33:26 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:33:26 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Sep 30 19:33:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:33:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:33:26 devstack sudo[86044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:33:26 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:33:26 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root Sep 30 19:33:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:33:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:33:26 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 19:33:26 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:33:26 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Sep 30 19:33:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:33:26 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:33:26 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 19:33:26 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:33:27 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Sep 30 19:33:27 devstack cinder-volume[76585]: DEBUG oslo_concurrency.processutils [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:33:27 devstack cinder-volume[76585]: DEBUG cinder.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Notifying Schedulers of capabilities ... {{(pid=76585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:33:27 devstack cinder-volume[76585]: DEBUG oslo_service.periodic_task [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] Running periodic task VolumeManager._thread_info {{(pid=76585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:33:27 devstack cinder-volume[76585]: DEBUG cinder.volume.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] thread count: 6 {{(pid=76585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:33:27 devstack cinder-volume[76585]: DEBUG cinder.volume.manager [None req-555ab367-612e-4ec9-9e4c-02eb02983015 None None] thread info: [<_MainThread(MainThread, started 132236966658176)>, , , , , ] {{(pid=76585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:33:36 devstack cinder-volume[76585]: DEBUG dbcounter [-] [76585] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:33:46 devstack cinder-volume[76429]: INFO oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Caught SIGTERM, stopping children Sep 30 19:33:46 devstack cinder-volume[76429]: DEBUG oslo_concurrency.lockutils [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Acquiring lock "singleton_lock" {{(pid=76429) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 19:33:46 devstack cinder-volume[76429]: DEBUG oslo_concurrency.lockutils [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Acquired lock "singleton_lock" {{(pid=76429) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 19:33:46 devstack cinder-volume[76429]: DEBUG oslo_concurrency.lockutils [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Releasing lock "singleton_lock" {{(pid=76429) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 19:33:46 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Stop services. {{(pid=76429) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 30 19:33:46 devstack cinder-volume[76429]: DEBUG oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Killing children. {{(pid=76429) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 30 19:33:46 devstack cinder-volume[76429]: INFO oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Waiting on 1 children to exit Sep 30 19:33:50 devstack cinder-volume[76585]: DEBUG oslo_concurrency.lockutils [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Acquiring lock "singleton_lock" {{(pid=76585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 19:33:50 devstack cinder-volume[76585]: DEBUG oslo_concurrency.lockutils [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Acquired lock "singleton_lock" {{(pid=76585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 19:33:50 devstack cinder-volume[76585]: DEBUG oslo_concurrency.lockutils [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Releasing lock "singleton_lock" {{(pid=76585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 19:33:50 devstack cinder-volume[76585]: WARNING amqp [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 19:33:50 devstack cinder-volume[76585]: WARNING amqp [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 19:33:50 devstack cinder-volume[76429]: INFO oslo_service.backend._eventlet.service [None req-02cbcebc-7bd7-44fb-a13b-bf8babdd8913 None None] Child 76585 exited with status 0 Sep 30 19:33:50 devstack cinder-volume[86551]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 30 19:33:50 devstack cinder-volume[86551]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 19:33:50 devstack cinder-volume[86551]: we strongly recommend against using it for new projects. Sep 30 19:33:50 devstack cinder-volume[86551]: If you are already using Eventlet, we recommend migrating to a different Sep 30 19:33:50 devstack cinder-volume[86551]: framework. For more detail see Sep 30 19:33:50 devstack cinder-volume[86551]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 19:33:50 devstack cinder-volume[86551]: import eventlet # noqa Sep 30 19:33:52 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 19:33:52 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 19:33:52 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 19:33:53 devstack cinder-volume[86551]: INFO dbcounter [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Registered counter for database cinder Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writer thread running {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 19:33:53 devstack cinder-volume[86551]: INFO cinder.rpc [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 30 19:33:53 devstack cinder-volume[86551]: INFO cinder.rpc [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:33:53 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Determined volume DB was empty at startup. Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG cinder.volume.manager [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86551) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 30 19:33:53 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 30 19:33:53 devstack cinder-volume[86551]: WARNING stevedore.named [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 19:33:53 devstack cinder-volume[86551]: WARNING castellan.key_manager [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 19:33:53 devstack cinder-volume[86551]: WARNING cinder.keymgr.conf_key_mgr [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 19:33:53 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:33:53 devstack cinder-volume[86551]: INFO oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Starting 1 workers Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Started child 86767 {{(pid=86551) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Full set of CONF: {{(pid=86551) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] ******************************************************************************** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Configuration options gathered from: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] ================================================================================ {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] allow_availability_zone_fallback = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] allow_compression_on_image_upload = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] allowed_direct_url_schemes = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] api_rate_limit = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] auth_strategy = keystone {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_availability_zone = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_host = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_stats_polling_interval = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backup_api_class = cinder.backup.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backup_name_template = backup-%s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backup_use_same_host = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backup_use_temp_snapshot = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] chap_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] chap_username = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86767]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cinder_internal_tenant_project_id = c188480d80144ffca421484cda916122 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cinder_internal_tenant_user_id = 878b404de67b45e9b891d8f45b99bf73 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cluster = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] compression_format = gzip {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] compute_api_class = cinder.compute.nova.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] config_dir = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] config_source = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] control_exchange = openstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] debug = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] default_availability_zone = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] default_group_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] default_volume_type = QuobyteHD {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] disk_geometry = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] driver_client_cert = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] driver_client_cert_key = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] driver_data_namespace = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] driver_ssl_cert_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] driver_ssl_cert_verify = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] driver_use_ssl = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] enable_new_services = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] enable_unsupported_driver = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] enabled_backends = ['QuobyteHD'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] enforce_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] filter_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_api_insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_api_ssl_compression = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_ca_certificates_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_catalog_info = image:glance:publicURL {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_num_retries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance_request_timeout = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] goodness_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] graceful_shutdown_timeout = 5 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] group_api_class = cinder.group.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] host = devstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_compress_on_upload = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_conversion_address_space_limit = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_conversion_cpu_limit = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_conversion_disable = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_introspection_address_space_limit = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_introspection_cpu_limit = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_upload_use_cinder_backend = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_upload_use_internal_tenant = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_volume_cache_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_volume_cache_max_count = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] image_volume_cache_max_size_gb = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] init_host_max_objects_retrieval = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] instance_format = [instance: %(uuid)s] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] iscsi_target_flags = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] iscsi_write_cache = on {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] iser_helper = tgtadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] iser_ip_address = 192.168.122.24 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] iser_port = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] log_color = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] log_config_append = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] log_dir = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] log_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] log_options = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] log_rotate_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] log_rotate_interval_type = days {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] log_rotation_type = none {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] max_age = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] max_logfile_count = 30 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] max_logfile_size_mb = 200 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] max_over_subscription_ratio = 20.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] message_reap_interval = 86400 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] message_ttl = 2592000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] migration_create_volume_timeout_secs = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] monkey_patch = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] monkey_patch_modules = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] my_ip = 192.168.122.24 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] no_snapshot_gb_quota = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] num_iser_scan_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] num_shell_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] num_volume_device_scan_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] nvmeof_conn_info_version = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] nvmet_ns_id = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] nvmet_port_id = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] osapi_max_limit = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] osapi_volume_ext_list = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] osapi_volume_listen_port = 8776 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] osapi_volume_use_ssl = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] osapi_volume_workers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] per_volume_size_limit = -1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] periodic_fuzzy_delay = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] periodic_interval = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] public_endpoint = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] publish_errors = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] quota_backup_gigabytes = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] quota_backups = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] quota_gigabytes = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] quota_groups = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] quota_snapshots = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] quota_volumes = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] rate_limit_burst = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] rate_limit_except_level = CRITICAL {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] rate_limit_interval = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] reinit_driver_count = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] replication_device = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] report_discard_supported = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] report_interval = 120 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] reservation_clean_interval = 86400 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] reservation_expire = 86400 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:53 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] reserved_image_namespaces = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] reserved_percentage = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] rpc_response_timeout = 120 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] run_external_periodic_tasks = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] scst_target_driver = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] scst_target_iqn_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_down_time = 720 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] shell_completion = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] snapshot_name_template = snapshot-%s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] split_loggers = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] state_path = /opt/stack/data/cinder {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] storage_availability_zone = nova {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] storage_protocol = iSCSI {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] syslog_log_facility = LOG_USER {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] target_helper = lioadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] target_ip_address = 192.168.122.24 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] target_port = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] target_protocol = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] target_secondary_ip_addresses = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] trace_flags = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] transport_url = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] until_refresh = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] use_chap_auth = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] use_default_quota_class = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] use_journal = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] use_json = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] use_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] use_stderr = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] use_syslog = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] verify_glance_signatures = enabled {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_api_class = cinder.volume.api.API {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_backend_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_clear = zero {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_clear_ionice = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_clear_size = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_copy_bps_limit = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86767]: INFO cinder.volume.manager [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Starting volume driver QuobyteDriver (1.2.1) Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_dd_blocksize = 1M {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.remotefs [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86767) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_name_template = volume-%s {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_service_inithost_offload = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volume_usage_audit_period = month {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] zoning_mode = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_concurrency.disable_process_locking = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.auth_section = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.auth_type = password {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.auth_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.cache = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.include_service_catalog = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.interface = public {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcache_username = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.region_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.service_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.backend = dogpile.cache.null {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.backend_argument = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.backend_expiration_time = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.config_prefix = cache.oslo {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.debug_cache_backend = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.enable_retry_client = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.enable_socket_keepalive = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.expiration_time = 600 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.hashclient_retry_attempts = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.memcache_dead_retry = 300 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.memcache_pool_maxsize = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.memcache_sasl_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.proxies = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.redis_db = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.redis_server = localhost:6379 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.retry_attempts = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.retry_delay = 0.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.socket_keepalive_count = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.socket_keepalive_idle = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.socket_keepalive_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.socket_timeout = 1.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.tls_allowed_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.tls_cafile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.tls_certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.tls_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.tls_keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cache.username = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] coordination.backend_url = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.asyncio_connection = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.asyncio_slave_connection = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.backend = sqlalchemy {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.connection = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.connection_debug = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.connection_parameters = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.connection_recycle_time = 3600 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.connection_trace = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.db_inc_retry_interval = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.db_max_retries = 20 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.db_max_retry_interval = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.db_retry_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.max_overflow = 50 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.max_pool_size = 5 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.max_retries = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.mysql_wsrep_sync_wait = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.pool_timeout = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.retry_interval = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.slave_connection = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.sqlite_synchronous = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.synchronous_reader = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] database.use_db_reconnect = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_tracing.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.connection_string = messaging:// {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.es_doc_type = notification {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.es_scroll_size = 10000 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.es_scroll_time = 2m {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.filter_error_trace = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.hmac_keys = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.sentinel_service_name = mymaster {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.socket_timeout = 0.1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.trace_requests = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler.trace_sqlalchemy = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler_jaeger.process_tags = {} {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler_jaeger.service_name_prefix = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] profiler_otlp.service_name_prefix = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.enforce_new_defaults = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.policy_default_rule = default {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.policy_file = policy.yaml {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] privsep_osbrick.group = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] privsep_osbrick.helper_command = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] privsep_osbrick.user = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cinder_sys_admin.group = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cinder_sys_admin.helper_command = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] cinder_sys_admin.user = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.auth_section = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.auth_type = password {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.cafile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.collect_timing = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.send_service_user_token = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.split_loggers = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.timeout = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.tls_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] service_user.tls_min_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.auth_section = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.auth_type = password {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.collect_timing = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.region_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.split_loggers = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.timeout = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.tls_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] glance.tls_min_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.backend_availability_zone = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.chap_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.chap_username = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.disk_geometry = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.driver_client_cert = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.driver_client_cert_key = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.driver_data_namespace = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.driver_use_ssl = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.extra_capabilities = {} {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.filter_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.goodness_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.iscsi_target_flags = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.iscsi_write_cache = on {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.iser_helper = tgtadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.iser_port = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86767) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86767]: WARNING cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 30 19:33:54 devstack cinder-volume[86767]: WARNING cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_host = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_login = admin {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_mount_options = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_private_key = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_share_path = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Running cmd (subprocess): mount.quobyte {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.num_shell_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.quobyte_volume_url = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.replication_device = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.report_discard_supported = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.reserved_percentage = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.target_helper = tgtadm {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.target_port = 3260 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.target_protocol = iscsi {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.trace_flags = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.unique_fqdn_network = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.use_chap_auth = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.volume_backend_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.volume_clear = zero {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.volume_clear_ionice = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.volume_clear_size = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_reports.file_event_handler = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_reports.log_dir = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.backend_availability_zone = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.backend_host = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.chap_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.chap_username = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.chiscsi_conf = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.disk_geometry = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.driver_client_cert = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.driver_data_namespace = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.driver_use_ssl = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.extra_capabilities = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.filter_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.goodness_function = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.iser_helper = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.iser_ip_address = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.iser_port = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.iser_target_prefix = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_host = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_login = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_mount_options = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_password = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_private_key = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_share_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_ssh_port = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.num_shell_tries = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.nvmet_port_id = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.replication_device = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.report_discard_supported = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.reserved_percentage = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.scst_target_driver = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.storage_protocol = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.target_helper = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.target_ip_address = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.target_port = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.target_prefix = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.target_protocol = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.trace_flags = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.use_chap_auth = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.volume_clear = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.volume_clear_size = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] QuobyteHD.volumes_dir = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] CMD "mount.quobyte" returned: 1 in 0.133s {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.ssl = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=86767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:33:54 devstack cinder-volume[86767]: INFO cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 ... Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 -c /etc/quobyte/client-cinder.cfg {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_notifications.driver = [] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_notifications.retry = -1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] key_manager.fixed_key = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.barbican_api_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.barbican_endpoint = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.barbican_endpoint_type = public {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.barbican_region_name = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.cafile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.collect_timing = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.number_of_retries = 60 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.retry_delay = 1 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.send_service_user_token = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.split_loggers = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.timeout = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.tls_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.tls_min_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.verify_ssl = True {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican.verify_ssl_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.auth_section = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.auth_type = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.cafile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.certfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.collect_timing = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.insecure = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.keyfile = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.split_loggers = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.timeout = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.tls_ciphers = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] barbican_service_user.tls_min_version = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.approle_role_id = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.approle_secret_id = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.auth_method = approle {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 -c /etc/quobyte/client-cinder.cfg Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.auth_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.kv_mountpoint = secret {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.kv_path = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.kv_version = 2 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.namespace = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.root_token_id = **** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.ssl_ca_crt_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.timeout = 60.0 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.token_file = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.token_role = None {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.use_ssl = False {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:33:54 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] ******************************************************************************** {{(pid=86551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 30 19:33:54 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.403s {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:33:54 devstack cinder-volume[86767]: INFO cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 succeeded Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=86767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.415s {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:33:54 devstack sudo[86875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:33:54 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:33:54 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.230s {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:33:54 devstack cinder-volume[86767]: INFO cinder.volume.driver [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Driver hasn't implemented _init_vendor_properties() Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG cinder.volume.driver [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8975448608398, 'free_capacity_gb': 1774.8975448608398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86767) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_db.sqlalchemy.engines [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86767) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG dbcounter [-] [86767] Writer thread running {{(pid=86767) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG cinder.db.api [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Building query based on filter {{(pid=86767) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3962}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG cinder.image.image_utils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86767) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 30 19:33:54 devstack cinder-volume[86767]: INFO cinder.keymgr.migration [None req-80c4920d-e9ea-499a-9c3c-8013abcd6043 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=86767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=86767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:33:54 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:33:55 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:33:55 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:33:55 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.233s {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG cinder.manager [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Notifying Schedulers of capabilities ... {{(pid=86767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:33:55 devstack cinder-volume[86767]: INFO cinder.volume.manager [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Driver initialization completed successfully. Sep 30 19:33:55 devstack cinder-volume[86767]: INFO cinder.manager [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Initiating service 3 cleanup Sep 30 19:33:55 devstack cinder-volume[86767]: INFO cinder.manager [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Service 3 cleanup completed. Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG cinder.service [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Creating RPC server for service cinder-volume {{(pid=86767) start /opt/stack/cinder/cinder/service.py:231}} Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG cinder.service [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86767) start /opt/stack/cinder/cinder/service.py:237}} Sep 30 19:33:55 devstack cinder-volume[86767]: INFO cinder.volume.manager [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=86767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.quobyte [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=86767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:33:55 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:33:55 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:33:55 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Sep 30 19:33:55 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.234s {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:33:55 devstack cinder-volume[86767]: INFO cinder.volume.manager [None req-2a516dcb-0458-4bcd-aec8-8f6cfc8a608a None None] Driver post RPC initialization completed successfully. Sep 30 19:33:57 devstack cinder-volume[86767]: DEBUG oslo_service.periodic_task [None req-27c3b4eb-ba8c-44e6-a3ba-99778de94d58 None None] Running periodic task VolumeManager._thread_info {{(pid=86767) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:33:57 devstack cinder-volume[86767]: DEBUG cinder.volume.manager [None req-27c3b4eb-ba8c-44e6-a3ba-99778de94d58 None None] thread count: 6 {{(pid=86767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:33:57 devstack cinder-volume[86767]: DEBUG cinder.volume.manager [None req-27c3b4eb-ba8c-44e6-a3ba-99778de94d58 None None] thread info: [<_MainThread(MainThread, started 136893679267968)>, , , , , ] {{(pid=86767) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:34:00 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:34:00 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:34:00 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.quobyte [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=86767) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:34:00 devstack cinder-volume[86767]: DEBUG cinder.volume.drivers.quobyte [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=86767) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:34:00 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86767) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:34:00 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:34:00 devstack sudo[87068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:34:00 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:34:00 devstack cinder-volume[86551]: INFO oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Caught SIGTERM, stopping children Sep 30 19:34:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Acquiring lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 19:34:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Acquired lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 19:34:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Releasing lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 19:34:00 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Stop services. {{(pid=86551) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 30 19:34:00 devstack cinder-volume[86551]: DEBUG oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Killing children. {{(pid=86551) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 30 19:34:00 devstack cinder-volume[86551]: INFO oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Waiting on 1 children to exit Sep 30 19:34:00 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root Sep 30 19:34:00 devstack cinder-volume[86767]: DEBUG oslo_concurrency.processutils [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.265s {{(pid=86767) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:34:00 devstack cinder-volume[86767]: DEBUG cinder.manager [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Notifying Schedulers of capabilities ... {{(pid=86767) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Unable to connect to AMQP server on 192.168.122.24:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server [None req-0ef6c3fe-fb63-4006-92c3-7cecbf78b4bd None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.24:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server method() Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server return _publish( Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server listener(*args) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.24:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 30 19:34:00 devstack cinder-volume[86767]: ERROR oslo_messaging.rpc.server Sep 30 19:34:03 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Acquiring lock "singleton_lock" {{(pid=86767) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 19:34:03 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Acquired lock "singleton_lock" {{(pid=86767) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 19:34:03 devstack cinder-volume[86767]: DEBUG oslo_concurrency.lockutils [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Releasing lock "singleton_lock" {{(pid=86767) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 19:34:03 devstack cinder-volume[86767]: WARNING amqp [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 19:34:03 devstack cinder-volume[86767]: WARNING amqp [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 19:34:03 devstack cinder-volume[86551]: INFO oslo_service.backend._eventlet.service [None req-092ae539-4f11-49cb-a4ab-c92b81856251 None None] Child 86767 exited with status 0 Sep 30 19:34:04 devstack cinder-volume[87130]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 30 19:34:04 devstack cinder-volume[87130]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 19:34:04 devstack cinder-volume[87130]: we strongly recommend against using it for new projects. Sep 30 19:34:04 devstack cinder-volume[87130]: If you are already using Eventlet, we recommend migrating to a different Sep 30 19:34:04 devstack cinder-volume[87130]: framework. For more detail see Sep 30 19:34:04 devstack cinder-volume[87130]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 19:34:04 devstack cinder-volume[87130]: import eventlet # noqa Sep 30 19:34:07 devstack cinder-volume[87130]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 19:34:07 devstack cinder-volume[87130]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 19:34:07 devstack cinder-volume[87130]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 19:34:07 devstack cinder-volume[87130]: INFO dbcounter [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Registered counter for database cinder Sep 30 19:34:07 devstack cinder-volume[87130]: DEBUG oslo_db.sqlalchemy.engines [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG dbcounter [-] [87130] Writer thread running {{(pid=87130) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 19:34:08 devstack cinder-volume[87130]: INFO cinder.rpc [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 30 19:34:08 devstack cinder-volume[87130]: INFO cinder.rpc [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_db.sqlalchemy.engines [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:34:08 devstack cinder-volume[87130]: INFO cinder.volume.manager [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Determined volume DB was empty at startup. Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG cinder.volume.manager [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87130) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 30 19:34:08 devstack cinder-volume[87130]: WARNING stevedore.named [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 19:34:08 devstack cinder-volume[87130]: WARNING castellan.key_manager [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 19:34:08 devstack cinder-volume[87130]: WARNING cinder.keymgr.conf_key_mgr [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 19:34:08 devstack cinder-volume[87130]: INFO cinder.volume.manager [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_db.sqlalchemy.engines [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:34:08 devstack cinder-volume[87130]: INFO oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Starting 1 workers Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Started child 87426 {{(pid=87130) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Full set of CONF: {{(pid=87130) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] ******************************************************************************** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] Configuration options gathered from: {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] ================================================================================ {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 30 19:34:08 devstack cinder-volume[87426]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] allow_availability_zone_fallback = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] allow_compression_on_image_upload = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] allowed_direct_url_schemes = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] api_rate_limit = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] auth_strategy = keystone {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_availability_zone = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_host = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_stats_polling_interval = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backup_api_class = cinder.backup.api.API {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backup_name_template = backup-%s {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backup_use_same_host = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backup_use_temp_snapshot = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] chap_password = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] chap_username = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cinder_internal_tenant_project_id = c188480d80144ffca421484cda916122 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cinder_internal_tenant_user_id = 878b404de67b45e9b891d8f45b99bf73 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cluster = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] compression_format = gzip {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] compute_api_class = cinder.compute.nova.API {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] config_dir = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] config_source = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] control_exchange = openstack {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] debug = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] default_availability_zone = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] default_group_type = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] default_volume_type = QuobyteHD {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] disk_geometry = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] driver_client_cert = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] driver_client_cert_key = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] driver_data_namespace = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] driver_ssl_cert_path = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] driver_ssl_cert_verify = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] driver_use_ssl = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] enable_new_services = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] enable_unsupported_driver = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] enabled_backends = ['QuobyteHD'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] enforce_multipath_for_image_xfer = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] filter_function = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_api_insecure = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_api_servers = ['http://192.168.122.24/image'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_api_ssl_compression = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_ca_certificates_file = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_catalog_info = image:glance:publicURL {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_certfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_keyfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_num_retries = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance_request_timeout = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] goodness_function = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] graceful_shutdown_timeout = 5 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] group_api_class = cinder.group.api.API {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] host = devstack {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_compress_on_upload = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_conversion_address_space_limit = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_conversion_cpu_limit = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_conversion_disable = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_introspection_address_space_limit = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_introspection_cpu_limit = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_upload_use_cinder_backend = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_upload_use_internal_tenant = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_volume_cache_enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_volume_cache_max_count = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] image_volume_cache_max_size_gb = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] init_host_max_objects_retrieval = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] instance_format = [instance: %(uuid)s] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] iscsi_target_flags = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] iscsi_write_cache = on {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] iser_helper = tgtadm {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] iser_ip_address = 192.168.122.24 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] iser_port = 3260 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] log_color = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] log_config_append = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] log_dir = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] log_file = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] log_options = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] log_rotate_interval = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] log_rotate_interval_type = days {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] log_rotation_type = none {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] max_age = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] max_logfile_count = 30 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] max_logfile_size_mb = 200 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] max_over_subscription_ratio = 20.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] message_reap_interval = 86400 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] message_ttl = 2592000 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] migration_create_volume_timeout_secs = 300 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87426) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] monkey_patch = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] monkey_patch_modules = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] my_ip = 192.168.122.24 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] no_snapshot_gb_quota = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] num_iser_scan_tries = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] num_shell_tries = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] num_volume_device_scan_tries = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] nvmeof_conn_info_version = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] nvmet_ns_id = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] nvmet_port_id = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] osapi_max_limit = 1000 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] osapi_volume_ext_list = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] osapi_volume_listen_port = 8776 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] osapi_volume_use_ssl = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] osapi_volume_workers = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] per_volume_size_limit = -1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] periodic_fuzzy_delay = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] periodic_interval = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] public_endpoint = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] publish_errors = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] quota_backup_gigabytes = 1000 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] quota_backups = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] quota_gigabytes = 1000 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] quota_groups = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] quota_snapshots = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] quota_volumes = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] rate_limit_burst = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] rate_limit_except_level = CRITICAL {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] rate_limit_interval = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] reinit_driver_count = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] replication_device = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] report_discard_supported = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] report_interval = 120 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] reservation_clean_interval = 86400 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] reservation_expire = 86400 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] reserved_image_namespaces = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] reserved_percentage = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] rpc_response_timeout = 120 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] run_external_periodic_tasks = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] scst_target_driver = iscsi {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] scst_target_iqn_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_down_time = 720 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] shell_completion = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] snapshot_name_template = snapshot-%s {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] split_loggers = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] state_path = /opt/stack/data/cinder {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] storage_availability_zone = nova {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] storage_protocol = iSCSI {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] syslog_log_facility = LOG_USER {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] target_helper = lioadm {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] target_ip_address = 192.168.122.24 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] target_port = 3260 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] target_protocol = iscsi {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] target_secondary_ip_addresses = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] trace_flags = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] transport_url = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] until_refresh = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] use_chap_auth = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] use_default_quota_class = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] use_journal = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] use_json = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] use_multipath_for_image_xfer = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] use_stderr = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] use_syslog = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] verify_glance_signatures = enabled {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_api_class = cinder.volume.api.API {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_backend_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_clear = zero {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_clear_ionice = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_clear_size = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_copy_bps_limit = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_dd_blocksize = 1M {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_name_template = volume-%s {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_service_inithost_offload = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volume_usage_audit_period = month {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] zoning_mode = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_concurrency.disable_process_locking = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.auth_section = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.auth_type = password {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.auth_version = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.cache = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.certfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.include_service_catalog = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.insecure = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.interface = public {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.keyfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_password = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87426) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.quobyte [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.quobyte [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcache_username = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.region_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Running cmd (subprocess): mount.quobyte {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.service_type = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.backend = dogpile.cache.null {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.backend_argument = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.backend_expiration_time = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.config_prefix = cache.oslo {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.debug_cache_backend = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.enable_retry_client = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.enable_socket_keepalive = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.expiration_time = 600 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.hashclient_retry_attempts = 2 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.memcache_dead_retry = 300 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.memcache_pool_maxsize = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.memcache_sasl_enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.password = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.proxies = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.redis_db = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.redis_server = localhost:6379 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.retry_attempts = 2 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.retry_delay = 0.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.socket_keepalive_count = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.socket_keepalive_idle = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.socket_keepalive_interval = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.socket_timeout = 1.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.tls_allowed_ciphers = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.tls_cafile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.tls_certfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.tls_enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.tls_keyfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cache.username = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] coordination.backend_url = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.asyncio_connection = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.asyncio_slave_connection = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.backend = sqlalchemy {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.connection = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.connection_debug = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.connection_parameters = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.connection_recycle_time = 3600 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.connection_trace = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.db_inc_retry_interval = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.db_max_retries = 20 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.db_max_retry_interval = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.db_retry_interval = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.max_overflow = 50 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.max_pool_size = 5 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.max_retries = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.mysql_wsrep_sync_wait = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.pool_timeout = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.retry_interval = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.slave_connection = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.sqlite_synchronous = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.synchronous_reader = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] database.use_db_reconnect = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_tracing.insecure = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.connection_string = messaging:// {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.es_doc_type = notification {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.es_scroll_size = 10000 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.es_scroll_time = 2m {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.filter_error_trace = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.hmac_keys = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.sentinel_service_name = mymaster {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.socket_timeout = 0.1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.trace_requests = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler.trace_sqlalchemy = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler_jaeger.process_tags = {} {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler_jaeger.service_name_prefix = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] profiler_otlp.service_name_prefix = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.enforce_new_defaults = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.policy_default_rule = default {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.policy_file = policy.yaml {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] privsep_osbrick.group = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] privsep_osbrick.helper_command = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] privsep_osbrick.user = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cinder_sys_admin.group = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cinder_sys_admin.helper_command = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] cinder_sys_admin.user = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.auth_section = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.auth_type = password {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.cafile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.certfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.collect_timing = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.insecure = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.keyfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.send_service_user_token = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.split_loggers = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.timeout = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.tls_ciphers = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] service_user.tls_min_version = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.auth_section = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.auth_type = password {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.certfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.collect_timing = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.insecure = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.keyfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.region_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.split_loggers = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.timeout = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.tls_ciphers = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] glance.tls_min_version = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.backend_availability_zone = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.chap_password = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.chap_username = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.disk_geometry = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.driver_client_cert = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.driver_client_cert_key = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.driver_data_namespace = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.driver_use_ssl = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.extra_capabilities = {} {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.filter_function = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.goodness_function = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.iscsi_target_flags = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.iscsi_write_cache = on {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.iser_helper = tgtadm {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.iser_port = 3260 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_host = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_login = admin {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_mount_options = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_password = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_private_key = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_share_path = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.num_shell_tries = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.quobyte_volume_url = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.replication_device = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.report_discard_supported = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.reserved_percentage = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.target_helper = tgtadm {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.target_port = 3260 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.target_protocol = iscsi {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.trace_flags = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.unique_fqdn_network = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.use_chap_auth = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.volume_backend_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.volume_clear = zero {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.volume_clear_ionice = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.volume_clear_size = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_reports.file_event_handler = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_reports.log_dir = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.backend_availability_zone = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.backend_host = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.chap_password = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.chap_username = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.chiscsi_conf = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.disk_geometry = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.driver_client_cert = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.driver_data_namespace = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.driver_use_ssl = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.extra_capabilities = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.filter_function = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.goodness_function = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:34:08 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.iser_helper = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.iser_ip_address = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.iser_port = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.iser_target_prefix = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_host = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_login = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_mount_options = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_password = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_private_key = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_share_path = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_ssh_port = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.num_shell_tries = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.nvmet_port_id = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.replication_device = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.report_discard_supported = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.reserved_percentage = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.scst_target_driver = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.storage_protocol = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.target_helper = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.target_ip_address = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.target_port = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.target_prefix = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.target_protocol = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.trace_flags = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.use_chap_auth = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.volume_clear = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.volume_clear_size = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] QuobyteHD.volumes_dir = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.ssl = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_notifications.driver = [] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_notifications.retry = -1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] key_manager.fixed_key = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.barbican_api_version = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.barbican_endpoint = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.barbican_endpoint_type = public {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.barbican_region_name = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.cafile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.certfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.collect_timing = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.insecure = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.keyfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.number_of_retries = 60 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.retry_delay = 1 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.send_service_user_token = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.split_loggers = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.timeout = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.tls_ciphers = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.tls_min_version = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.verify_ssl = True {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican.verify_ssl_path = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.auth_section = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.auth_type = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.cafile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.certfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.collect_timing = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.insecure = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.keyfile = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.split_loggers = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.timeout = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.tls_ciphers = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] barbican_service_user.tls_min_version = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.approle_role_id = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.approle_secret_id = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.auth_method = approle {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.auth_path = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.kv_mountpoint = secret {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.kv_path = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.kv_version = 2 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.namespace = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.root_token_id = **** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.ssl_ca_crt_file = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.timeout = 60.0 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.token_file = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.token_role = None {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.use_ssl = False {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 19:34:08 devstack cinder-volume[87130]: DEBUG oslo_service.backend._eventlet.service [None req-2a68665c-5b41-49e2-90e7-c90c9be321d9 None None] ******************************************************************************** {{(pid=87130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 30 19:34:09 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.291s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:34:09 devstack cinder-volume[87426]: INFO cinder.volume.driver [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Driver hasn't implemented _init_vendor_properties() Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.volume.driver [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8975448608398, 'free_capacity_gb': 1774.8975448608398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87426) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_db.sqlalchemy.engines [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writer thread running {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.db.api [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Building query based on filter {{(pid=87426) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3962}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87426) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:34:09 devstack cinder-volume[87426]: INFO cinder.keymgr.migration [None req-2b55ea8d-c4f7-4173-9931-f4d9599dcb39 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 30 19:34:09 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:34:09 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:34:09 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.239s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:34:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Driver initialization completed successfully. Sep 30 19:34:09 devstack cinder-volume[87426]: INFO cinder.manager [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Initiating service 3 cleanup Sep 30 19:34:09 devstack cinder-volume[87426]: INFO cinder.manager [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Service 3 cleanup completed. Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.service [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Creating RPC server for service cinder-volume {{(pid=87426) start /opt/stack/cinder/cinder/service.py:231}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.service [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87426) start /opt/stack/cinder/cinder/service.py:237}} Sep 30 19:34:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:34:09 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:34:09 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:34:09 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Sep 30 19:34:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:34:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-618d1681-21ff-42c3-bc19-8bd04abb6868 None None] Driver post RPC initialization completed successfully. Sep 30 19:34:18 devstack cinder-volume[87130]: DEBUG dbcounter [-] [87130] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87130) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:34:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:34:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=4 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:34:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:34:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 6 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:34:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Flow 'volume_create_manager' (f182f487-5591-4c21-9983-445b656ecd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70127b51-df3e-4b86-8156-8eb07b54537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70127b51-df3e-4b86-8156-8eb07b54537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-424381671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a74f9f3-8854-48c9-a816-99552cbdb526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715b45149c541ee92690f2014240770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:35:08Z,use_quota=True,user_id='a989d9f9c1d34e6da7efbaf45534e113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbc5cf5-15bb-4d14-8f19-c69b670feb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbc5cf5-15bb-4d14-8f19-c69b670feb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff620bf-90e2-4ce4-af65-6576b91475b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff620bf-90e2-4ce4-af65-6576b91475b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a74f9f3-8854-48c9-a816-99552cbdb526', 'volume_name': 'volume-3a74f9f3-8854-48c9-a816-99552cbdb526', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980c58d9-e63a-4cba-8ea4-d4d6c4f81d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980c58d9-e63a-4cba-8ea4-d4d6c4f81d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47b0a1f-b7d0-405a-b881-a929ed13a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:08 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Volume 3a74f9f3-8854-48c9-a816-99552cbdb526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a74f9f3-8854-48c9-a816-99552cbdb526', 'volume_size': 1} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-424381671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a74f9f3-8854-48c9-a816-99552cbdb526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715b45149c541ee92690f2014240770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:35:08Z,use_quota=True,user_id='a989d9f9c1d34e6da7efbaf45534e113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Creating volume 3a74f9f3-8854-48c9-a816-99552cbdb526 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:35:08 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:08 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526 1073741824 Sep 30 19:35:08 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:08 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526 1073741824" returned: 0 in 0.555s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:08 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526 Sep 30 19:35:08 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:09 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526" returned: 0 in 0.269s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:35:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47b0a1f-b7d0-405a-b881-a929ed13a357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a74f9f3-8854-48c9-a816-99552cbdb526', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92d5474-26c4-4103-bc5f-eeef31f41808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:09 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Volume volume-3a74f9f3-8854-48c9-a816-99552cbdb526 (3a74f9f3-8854-48c9-a816-99552cbdb526): created successfully Sep 30 19:35:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e92d5474-26c4-4103-bc5f-eeef31f41808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Flow 'volume_create_manager' (f182f487-5591-4c21-9983-445b656ecd3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:35:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b7278e14-3573-4d77-b306-e17552d4b427 tempest-TaggedAttachmentsTest-366824234 None] Created volume successfully. Sep 30 19:35:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:35:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:35:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:35:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:35:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:35:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:23 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:35:23 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:24 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.553s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:35:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:35:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 6 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:35:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Flow 'volume_create_manager' (150bb94a-8124-4362-8e65-bd1fd758c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74860729-f6f8-4062-b06f-db6e908c7ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74860729-f6f8-4062-b06f-db6e908c7ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1400518360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59a1d54-3519-403f-b3c1-f1120ab03836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669b136a402345128d54a0f2c8ed93c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:35:26Z,use_quota=True,user_id='e277156034044d9bbc28cb0e8ebd1aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac016ee-c634-4bd1-b5b8-ae2728392922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac016ee-c634-4bd1-b5b8-ae2728392922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a9095e-4401-491c-a39b-a76053e57958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a9095e-4401-491c-a39b-a76053e57958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59a1d54-3519-403f-b3c1-f1120ab03836', 'volume_name': 'volume-a59a1d54-3519-403f-b3c1-f1120ab03836', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9d93c0-a024-403e-b111-304a76f6ea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9d93c0-a024-403e-b111-304a76f6ea40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf4ef5d-bf1e-4525-a62a-fe2a9d6926cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:26 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Volume a59a1d54-3519-403f-b3c1-f1120ab03836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59a1d54-3519-403f-b3c1-f1120ab03836', 'volume_size': 1} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1400518360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59a1d54-3519-403f-b3c1-f1120ab03836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669b136a402345128d54a0f2c8ed93c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:35:26Z,use_quota=True,user_id='e277156034044d9bbc28cb0e8ebd1aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Creating volume a59a1d54-3519-403f-b3c1-f1120ab03836 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:35:26 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:26 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836 1073741824 Sep 30 19:35:26 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:26 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836 1073741824" returned: 0 in 0.583s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:26 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836 Sep 30 19:35:26 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:27 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836" returned: 0 in 0.435s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:35:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf4ef5d-bf1e-4525-a62a-fe2a9d6926cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59a1d54-3519-403f-b3c1-f1120ab03836', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73340d33-e35d-4beb-b830-b93219078024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Volume volume-a59a1d54-3519-403f-b3c1-f1120ab03836 (a59a1d54-3519-403f-b3c1-f1120ab03836): created successfully Sep 30 19:35:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73340d33-e35d-4beb-b830-b93219078024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Flow 'volume_create_manager' (150bb94a-8124-4362-8e65-bd1fd758c422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:35:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fe966add-2a95-4494-b915-88566196a555 tempest-DeleteServersTestJSON-896568387 None] Created volume successfully. Sep 30 19:35:34 devstack cinder-volume[87426]: WARNING py.warnings [req-5d867f80-07e1-454e-a8f9-a73dbc6bdd5a req-6a8acd38-e207-4df5-9f9d-78d72c923578 tempest-DeleteServersTestJSON-896568387 None] /opt/stack/cinder/cinder/db/api.py:2488: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 30 19:35:34 devstack cinder-volume[87426]: .first() Sep 30 19:35:34 devstack cinder-volume[87426]: Sep 30 19:35:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-5d867f80-07e1-454e-a8f9-a73dbc6bdd5a req-6a8acd38-e207-4df5-9f9d-78d72c923578 tempest-DeleteServersTestJSON-896568387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-5d867f80-07e1-454e-a8f9-a73dbc6bdd5a req-6a8acd38-e207-4df5-9f9d-78d72c923578 tempest-DeleteServersTestJSON-896568387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-5d867f80-07e1-454e-a8f9-a73dbc6bdd5a req-6a8acd38-e207-4df5-9f9d-78d72c923578 tempest-DeleteServersTestJSON-896568387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-5d867f80-07e1-454e-a8f9-a73dbc6bdd5a req-6a8acd38-e207-4df5-9f9d-78d72c923578 tempest-DeleteServersTestJSON-896568387 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-a59a1d54-3519-403f-b3c1-f1120ab03836', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01efe00c-808d-45ed-9792-9c8a3af45712', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:35:35 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-5d867f80-07e1-454e-a8f9-a73dbc6bdd5a req-6a8acd38-e207-4df5-9f9d-78d72c923578 tempest-DeleteServersTestJSON-896568387 None] attachment_update completed successfully. Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Flow 'volume_create_manager' (03c57e77-2ac7-4a54-bae0-15bdcb191c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c494603-03f1-4b7e-8c1f-cc6f705d0964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c494603-03f1-4b7e-8c1f-cc6f705d0964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-640362632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba75105-39ff-48a9-96d4-4d08853188df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4704472e2e3b4d1da6eee6c5fc9cc544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:35:37Z,use_quota=True,user_id='cfd45933af5a4a4b813b720ef9ec8914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0fdbfa-4b1d-45a4-b837-d88f618d29c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0fdbfa-4b1d-45a4-b837-d88f618d29c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85799a99-21a1-409f-9168-c674ff1f1daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85799a99-21a1-409f-9168-c674ff1f1daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba75105-39ff-48a9-96d4-4d08853188df', 'volume_name': 'volume-bba75105-39ff-48a9-96d4-4d08853188df', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53658ada-c0f7-477b-8324-e75010058472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53658ada-c0f7-477b-8324-e75010058472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500be3cb-d0db-4824-a7fa-85001d40d427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:37 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Volume bba75105-39ff-48a9-96d4-4d08853188df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba75105-39ff-48a9-96d4-4d08853188df', 'volume_size': 1} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-640362632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba75105-39ff-48a9-96d4-4d08853188df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4704472e2e3b4d1da6eee6c5fc9cc544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:35:37Z,use_quota=True,user_id='cfd45933af5a4a4b813b720ef9ec8914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Creating volume bba75105-39ff-48a9-96d4-4d08853188df {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:35:37 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:35:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:37 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df 1073741824 Sep 30 19:35:37 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:38 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df 1073741824" returned: 0 in 0.748s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:38 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df Sep 30 19:35:38 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:39 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df" returned: 0 in 0.706s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:35:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500be3cb-d0db-4824-a7fa-85001d40d427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba75105-39ff-48a9-96d4-4d08853188df', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae62bc0-2141-45df-b35e-a08bed166b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:35:39 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Volume volume-bba75105-39ff-48a9-96d4-4d08853188df (bba75105-39ff-48a9-96d4-4d08853188df): created successfully Sep 30 19:35:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae62bc0-2141-45df-b35e-a08bed166b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:35:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Flow 'volume_create_manager' (03c57e77-2ac7-4a54-bae0-15bdcb191c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:35:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6724a802-af88-4b85-915b-1824ce0e1687 tempest-VolumesAdminNegativeTest-609464393 None] Created volume successfully. Sep 30 19:35:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Acquiring lock "cinder-bba75105-39ff-48a9-96d4-4d08853188df-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:35:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Lock "cinder-bba75105-39ff-48a9-96d4-4d08853188df-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:35:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Acquiring lock "cinder-quobyte-bba75105-39ff-48a9-96d4-4d08853188df" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:35:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Lock "cinder-quobyte-bba75105-39ff-48a9-96d4-4d08853188df" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:35:41 devstack cinder-volume[87426]: INFO oslo.privsep.daemon [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6o4mrzff/privsep.sock'] Sep 30 19:35:41 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6o4mrzff/privsep.sock Sep 30 19:35:41 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:42 devstack cinder-volume[87426]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 30 19:35:42 devstack cinder-volume[87426]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 19:35:42 devstack cinder-volume[87426]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 30 19:35:42 devstack cinder-volume[87426]: WARNING oslo.privsep.daemon [-] privsep log: Sep 30 19:35:42 devstack cinder-volume[87426]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 30 19:35:42 devstack cinder-volume[87426]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 30 19:35:42 devstack cinder-volume[87426]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 19:35:42 devstack cinder-volume[87426]: WARNING oslo.privsep.daemon [-] privsep log: Sep 30 19:35:42 devstack cinder-volume[87426]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 30 19:35:43 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:43 devstack cinder-volume[87426]: INFO oslo.privsep.daemon [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Spawned new privsep daemon via rootwrap Sep 30 19:35:43 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Accepted privsep connection to /tmp/tmp6o4mrzff/privsep.sock {{(pid=87426) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 30 19:35:43 devstack cinder-volume[87426]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 30 19:35:43 devstack cinder-volume[87426]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 30 19:35:43 devstack cinder-volume[87426]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 30 19:35:43 devstack cinder-volume[87426]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89149 Sep 30 19:35:43 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[67de46ac-5c7c-4e5f-ba14-0f9def8e891f]: (2,) {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:35:43 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d0e7f7-56c5-4d45-8618-d95855c9e816]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:35:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:43 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df Sep 30 19:35:43 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:43 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-8b6e5c02-bc78-41ba-9aa9-37b509e0a535 req-1700840f-20fd-4c6b-8448-c7e0899b7e42 tempest-DeleteServersTestJSON-896568387 None] Terminate volume connection completed successfully. Sep 30 19:35:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-8b6e5c02-bc78-41ba-9aa9-37b509e0a535 req-1700840f-20fd-4c6b-8448-c7e0899b7e42 tempest-DeleteServersTestJSON-896568387 None] Deleting attachment 01efe00c-808d-45ed-9792-9c8a3af45712. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:35:43 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df" returned: 0 in 0.643s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:43 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df Sep 30 19:35:43 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:44 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bba75105-39ff-48a9-96d4-4d08853188df" returned: 0 in 0.639s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Lock "cinder-quobyte-bba75105-39ff-48a9-96d4-4d08853188df" released by "delete_volume" :: held 3.101s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:35:44 devstack cinder-volume[87426]: WARNING cinder.quota [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:35:44 devstack cinder-volume[87426]: WARNING cinder.quota [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:35:44 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Created reservations ['49cc6cf5-c9f6-4e31-b3b5-7a86296d2741', '9afad2de-1cd2-47ce-9d0c-384224fd5be9', '1fd4c5ed-f0f7-4531-9539-25ef718b17af', '7d2a5a58-aca3-4745-a931-dfa1110dfecd'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:35:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:35:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:35:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:45 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:35:45 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:45 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.619s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:45 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:35:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Deleted volume successfully. Sep 30 19:35:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35a90898-51b2-401e-baa1-1aea33d206f9 tempest-VolumesAdminNegativeTest-609464393 None] Lock "cinder-bba75105-39ff-48a9-96d4-4d08853188df-delete_volume" released by "delete_volume" :: held 4.502s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:35:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Acquiring lock "cinder-a59a1d54-3519-403f-b3c1-f1120ab03836-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:35:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Lock "cinder-a59a1d54-3519-403f-b3c1-f1120ab03836-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:35:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Acquiring lock "cinder-quobyte-a59a1d54-3519-403f-b3c1-f1120ab03836" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:35:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Lock "cinder-quobyte-a59a1d54-3519-403f-b3c1-f1120ab03836" acquired by "delete_volume" :: waited 0.036s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:35:47 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6cba7e-62ec-415e-9f48-a6dd810e6956]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:35:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:47 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836 Sep 30 19:35:47 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:48 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836" returned: 0 in 0.519s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:48 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836 Sep 30 19:35:48 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:48 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a59a1d54-3519-403f-b3c1-f1120ab03836" returned: 0 in 0.386s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Lock "cinder-quobyte-a59a1d54-3519-403f-b3c1-f1120ab03836" released by "delete_volume" :: held 0.996s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Created reservations ['9af97f9f-9305-4b85-9e66-efb1fe464c0b', 'caa156dc-5927-4eb8-9019-e8012d9a4585', 'c5136dfa-6454-458c-9026-8d343d70c313', 'bb11ac28-2d8b-4bab-8627-98d521c970bf'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:35:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:35:48 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:35:48 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:35:49 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Sep 30 19:35:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.363s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:35:49 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:35:49 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Deleted volume successfully. Sep 30 19:35:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-510b3868-d81e-43b5-bf43-bda6ee50a838 tempest-DeleteServersTestJSON-896568387 None] Lock "cinder-a59a1d54-3519-403f-b3c1-f1120ab03836-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:35:58 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=25,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:35:59 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=29,cinder:SELECT=20,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:36:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:36:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:36:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-20f4ba61-9198-4142-8369-22faea15b537 req-555f887e-7b2c-4ea9-b684-6671c4eaba62 tempest-TaggedAttachmentsTest-366824234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:36:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-20f4ba61-9198-4142-8369-22faea15b537 req-555f887e-7b2c-4ea9-b684-6671c4eaba62 tempest-TaggedAttachmentsTest-366824234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:36:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-20f4ba61-9198-4142-8369-22faea15b537 req-555f887e-7b2c-4ea9-b684-6671c4eaba62 tempest-TaggedAttachmentsTest-366824234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:36:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-20f4ba61-9198-4142-8369-22faea15b537 req-555f887e-7b2c-4ea9-b684-6671c4eaba62 tempest-TaggedAttachmentsTest-366824234 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-3a74f9f3-8854-48c9-a816-99552cbdb526', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d4d5391-cc2e-4de5-aca9-b9d3ca486914', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:36:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-20f4ba61-9198-4142-8369-22faea15b537 req-555f887e-7b2c-4ea9-b684-6671c4eaba62 tempest-TaggedAttachmentsTest-366824234 None] attachment_update completed successfully. Sep 30 19:36:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:36:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:36:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:36:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:36:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:36:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:36:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:36:23 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:36:23 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:36:24 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Sep 30 19:36:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.268s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:36:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:36:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:36:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 8 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:36:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:36:25 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-4b1f2f57-c71d-4e97-8be2-470327f09f47 req-b657a962-201f-4b04-909f-dac76110c388 tempest-TaggedAttachmentsTest-366824234 None] Terminate volume connection completed successfully. Sep 30 19:36:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-4b1f2f57-c71d-4e97-8be2-470327f09f47 req-b657a962-201f-4b04-909f-dac76110c388 tempest-TaggedAttachmentsTest-366824234 None] Deleting attachment 1d4d5391-cc2e-4de5-aca9-b9d3ca486914. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:36:30 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:36:35 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:36:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Acquiring lock "cinder-3a74f9f3-8854-48c9-a816-99552cbdb526-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:36:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Lock "cinder-3a74f9f3-8854-48c9-a816-99552cbdb526-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:36:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Acquiring lock "cinder-quobyte-3a74f9f3-8854-48c9-a816-99552cbdb526" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:36:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Lock "cinder-quobyte-3a74f9f3-8854-48c9-a816-99552cbdb526" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:36:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b6e74e-ded8-4354-9aed-2226fc867a1e]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:36:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:36:50 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526 Sep 30 19:36:50 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:36:51 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526" returned: 0 in 1.113s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:36:51 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526 Sep 30 19:36:51 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:36:51 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3a74f9f3-8854-48c9-a816-99552cbdb526" returned: 0 in 0.472s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Lock "cinder-quobyte-3a74f9f3-8854-48c9-a816-99552cbdb526" released by "delete_volume" :: held 1.690s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Created reservations ['7c45a6ed-2131-4c63-8fce-98c9473d5b61', 'c053c01b-fe59-4bba-9500-4519fc6bdb23', '11af549b-c7dd-46d5-ad13-c835452ff407', 'a7a1658a-ce9f-425f-8023-81454a2bf954'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:36:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:36:51 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:36:51 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:36:52 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Sep 30 19:36:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.607s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:36:52 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:36:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Deleted volume successfully. Sep 30 19:36:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6a0199e1-f8b7-4489-a482-b9fe3264dfc2 tempest-TaggedAttachmentsTest-366824234 None] Lock "cinder-3a74f9f3-8854-48c9-a816-99552cbdb526-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Flow 'volume_create_manager' (03bf6559-846f-4f88-9ed1-dabe4e074b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96290225-e0ce-4df0-a720-17947d50d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96290225-e0ce-4df0-a720-17947d50d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-547562339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0de6373-7810-404f-ab54-1915d1662c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b9e6b75e25843e697629c4d942659de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:36:53Z,use_quota=True,user_id='5b5bdc9926584fa989376a4e0a3339e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5dc7f2-f1ac-4ca6-8bc4-bae3cbfb2eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5dc7f2-f1ac-4ca6-8bc4-bae3cbfb2eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b8b20e-36e3-44e7-a374-cbfe6a7ea3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b8b20e-36e3-44e7-a374-cbfe6a7ea3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0de6373-7810-404f-ab54-1915d1662c2a', 'volume_name': 'volume-d0de6373-7810-404f-ab54-1915d1662c2a', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d26381c-4478-42e4-93d8-e9b1093dc7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d26381c-4478-42e4-93d8-e9b1093dc7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5f33cc-075d-4c18-9548-ce87337fb3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:36:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Volume d0de6373-7810-404f-ab54-1915d1662c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0de6373-7810-404f-ab54-1915d1662c2a', 'volume_size': 1} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-547562339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0de6373-7810-404f-ab54-1915d1662c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b9e6b75e25843e697629c4d942659de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:36:53Z,use_quota=True,user_id='5b5bdc9926584fa989376a4e0a3339e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Creating volume d0de6373-7810-404f-ab54-1915d1662c2a {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:36:53 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:36:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:36:53 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a 1073741824 Sep 30 19:36:53 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:36:54 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Sep 30 19:36:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a 1073741824" returned: 0 in 0.836s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:36:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:36:54 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a Sep 30 19:36:54 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:36:54 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Sep 30 19:36:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a" returned: 0 in 0.604s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:36:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:36:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:36:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5f33cc-075d-4c18-9548-ce87337fb3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0de6373-7810-404f-ab54-1915d1662c2a', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:36:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601a5de4-cf32-48da-95c7-85c362542975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:36:55 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Volume volume-d0de6373-7810-404f-ab54-1915d1662c2a (d0de6373-7810-404f-ab54-1915d1662c2a): created successfully Sep 30 19:36:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601a5de4-cf32-48da-95c7-85c362542975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:36:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Flow 'volume_create_manager' (03bf6559-846f-4f88-9ed1-dabe4e074b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:36:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-4fe185bf-ee78-4e94-9e0c-2d1d5ad61bc6 tempest-ServerRescueNegativeTestJSON-1783799247 None] Created volume successfully. Sep 30 19:37:01 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:37:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Flow 'volume_create_manager' (689fb605-3c46-418c-ad11-ea265eba6a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:37:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3985b740-4219-4ffb-8836-5508253e0b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3985b740-4219-4ffb-8836-5508253e0b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1352184895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3b96c5-a011-45dc-a1f7-1d3664af2e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1842037a342434fba9a315e06bf1064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:37:02Z,use_quota=True,user_id='402e34f7134d45e180edcc785800441f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908fee73-932d-427b-8911-fb59dca9e6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908fee73-932d-427b-8911-fb59dca9e6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3b2f55-4d5a-45d8-89fb-2e77e0fdcd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3b2f55-4d5a-45d8-89fb-2e77e0fdcd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c3b96c5-a011-45dc-a1f7-1d3664af2e4f', 'volume_name': 'volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92dbd99e-4ada-4372-bd6d-47797b009480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92dbd99e-4ada-4372-bd6d-47797b009480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2c03dc-951a-424a-b858-5412f8d700c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:02 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Volume 8c3b96c5-a011-45dc-a1f7-1d3664af2e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f', 'volume_size': 1} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1352184895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3b96c5-a011-45dc-a1f7-1d3664af2e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1842037a342434fba9a315e06bf1064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:37:02Z,use_quota=True,user_id='402e34f7134d45e180edcc785800441f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Creating volume 8c3b96c5-a011-45dc-a1f7-1d3664af2e4f {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:37:02 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:02 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f 1073741824 Sep 30 19:37:02 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:02 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f 1073741824" returned: 0 in 0.846s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:03 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f Sep 30 19:37:03 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:03 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f" returned: 0 in 0.688s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:37:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2c03dc-951a-424a-b858-5412f8d700c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61073e3f-a38e-46da-a4c4-630440f08183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:03 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Volume volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f (8c3b96c5-a011-45dc-a1f7-1d3664af2e4f): created successfully Sep 30 19:37:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61073e3f-a38e-46da-a4c4-630440f08183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Flow 'volume_create_manager' (689fb605-3c46-418c-ad11-ea265eba6a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:37:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a9d5de54-a8c7-48c3-a2bc-588eea159aba tempest-AttachVolumeTestJSON-932163569 None] Created volume successfully. Sep 30 19:37:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-f67a3c9c-10b6-4c66-82ad-d1dfc2ab129c req-fe01815c-8a45-4404-85b1-edc6e4273c6e tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-f67a3c9c-10b6-4c66-82ad-d1dfc2ab129c req-fe01815c-8a45-4404-85b1-edc6e4273c6e tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-f67a3c9c-10b6-4c66-82ad-d1dfc2ab129c req-fe01815c-8a45-4404-85b1-edc6e4273c6e tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-f67a3c9c-10b6-4c66-82ad-d1dfc2ab129c req-fe01815c-8a45-4404-85b1-edc6e4273c6e tempest-AttachVolumeTestJSON-932163569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6829c9e-77dd-4809-9644-470457192971', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:37:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-f67a3c9c-10b6-4c66-82ad-d1dfc2ab129c req-fe01815c-8a45-4404-85b1-edc6e4273c6e tempest-AttachVolumeTestJSON-932163569 None] attachment_update completed successfully. Sep 30 19:37:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Acquiring lock "cinder-d0de6373-7810-404f-ab54-1915d1662c2a-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:37:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "cinder-d0de6373-7810-404f-ab54-1915d1662c2a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:37:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Acquiring lock "cinder-quobyte-d0de6373-7810-404f-ab54-1915d1662c2a" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:37:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "cinder-quobyte-d0de6373-7810-404f-ab54-1915d1662c2a" acquired by "delete_volume" :: waited 0.050s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:37:16 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7056c438-c97f-4369-95d1-19366a61b52f]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:37:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:16 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a Sep 30 19:37:16 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:17 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a" returned: 0 in 1.014s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:17 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a Sep 30 19:37:17 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:17 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d0de6373-7810-404f-ab54-1915d1662c2a" returned: 0 in 0.399s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "cinder-quobyte-d0de6373-7810-404f-ab54-1915d1662c2a" released by "delete_volume" :: held 1.507s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Created reservations ['c5dd5659-9c30-4966-a6de-f307cf5aad9d', 'bde39828-106e-4661-b8e2-2b7406bfeb75', '1135a7d0-1057-417f-b578-2509e16ee234', '62557a60-5fc2-4374-a291-a171b4545d69'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:17 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:37:17 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:18 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.765s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:18 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:37:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Deleted volume successfully. Sep 30 19:37:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-428059c6-95f9-427a-bd9d-f573ecd69ae9 tempest-ServerRescueNegativeTestJSON-1783799247 None] Lock "cinder-d0de6373-7810-404f-ab54-1915d1662c2a-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:37:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:37:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:37:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:37:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:24 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:37:24 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:24 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.512s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Flow 'volume_create_manager' (3e541b19-20a1-4b20-a180-18eda8ca1075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c0c8a9-6a52-48df-95a7-51812198e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c0c8a9-6a52-48df-95a7-51812198e126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1714080295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4f4455-8b1f-4690-a880-bf3236034bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e39f591fca04482293b9c9d4911516ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:37:28Z,use_quota=True,user_id='faa590fbc4004fcf857769ae207d34e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d295967-f30d-4868-92aa-e090137f0de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d295967-f30d-4868-92aa-e090137f0de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8877c74-c223-40f8-b312-21fcce4a0462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8877c74-c223-40f8-b312-21fcce4a0462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d4f4455-8b1f-4690-a880-bf3236034bf7', 'volume_name': 'volume-5d4f4455-8b1f-4690-a880-bf3236034bf7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad813c4-0975-40e0-9fd2-1ad6ee6ad50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad813c4-0975-40e0-9fd2-1ad6ee6ad50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52249c76-6be3-48a5-b5e3-991c34595683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Volume 5d4f4455-8b1f-4690-a880-bf3236034bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d4f4455-8b1f-4690-a880-bf3236034bf7', 'volume_size': 1} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1714080295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4f4455-8b1f-4690-a880-bf3236034bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e39f591fca04482293b9c9d4911516ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:37:28Z,use_quota=True,user_id='faa590fbc4004fcf857769ae207d34e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Creating volume 5d4f4455-8b1f-4690-a880-bf3236034bf7 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:37:27 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:37:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:27 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 1073741824 Sep 30 19:37:27 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:28 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 1073741824" returned: 0 in 0.592s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:28 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 Sep 30 19:37:28 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:28 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7" returned: 0 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:37:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52249c76-6be3-48a5-b5e3-991c34595683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d4f4455-8b1f-4690-a880-bf3236034bf7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a11c1ba-d725-402b-9ff8-49eb82845dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:28 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Volume volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 (5d4f4455-8b1f-4690-a880-bf3236034bf7): created successfully Sep 30 19:37:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a11c1ba-d725-402b-9ff8-49eb82845dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Flow 'volume_create_manager' (3e541b19-20a1-4b20-a180-18eda8ca1075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:37:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b95c7e11-c283-478c-9b01-c13520d40244 tempest-AttachVolumeShelveTestJSON-650824443 None] Created volume successfully. Sep 30 19:37:38 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=36,cinder:SELECT=13,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:37:38 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=34,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=3 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:37:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-34a9115d-22ce-49cb-a82e-daba71f8563a tempest-GroupSnapshotsTest-566213301 None] Group tempest-GroupSnapshotsTest-Group-1724803649: creating Sep 30 19:37:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-34a9115d-22ce-49cb-a82e-daba71f8563a tempest-GroupSnapshotsTest-566213301 None] Group tempest-GroupSnapshotsTest-Group-1724803649: created successfully Sep 30 19:37:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-34a9115d-22ce-49cb-a82e-daba71f8563a tempest-GroupSnapshotsTest-566213301 None] Create group completed successfully. Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Flow 'volume_create_manager' (b6b06c80-ea43-4174-b386-8f8324c9e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98adb138-dab2-478f-8b2b-3341213c3021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98adb138-dab2-478f-8b2b-3341213c3021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764758218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=317d77b9-5d2d-405c-8afd-412274a0ab61,host='devstack@QuobyteHD#QuobyteHD',id=5a8cc930-4e87-4ad4-a48a-f5ddd7675c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb87c2046a44068ae97be5b47207e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:37:42Z,use_quota=True,user_id='5d9987f55b6d412b97836e97e0564936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(980ebb31-2ca1-47c7-a7e3-20be12bf93a3),volume_type_id=980ebb31-2ca1-47c7-a7e3-20be12bf93a3)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a627d0-8513-4a31-b90b-547bdd6f59f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a627d0-8513-4a31-b90b-547bdd6f59f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d340c6f-15d7-4808-9e43-8b077d451d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d340c6f-15d7-4808-9e43-8b077d451d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8cc930-4e87-4ad4-a48a-f5ddd7675c07', 'volume_name': 'volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a656fc-34e9-4ef2-bbd1-0d94d07cd464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a656fc-34e9-4ef2-bbd1-0d94d07cd464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59ce65a-7392-429f-9f86-2068ae47dc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:41 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Volume 5a8cc930-4e87-4ad4-a48a-f5ddd7675c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07', 'volume_size': 1} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=317d77b9-5d2d-405c-8afd-412274a0ab61,created_at=2026-09-30T17:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764758218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=317d77b9-5d2d-405c-8afd-412274a0ab61,host='devstack@QuobyteHD#QuobyteHD',id=5a8cc930-4e87-4ad4-a48a-f5ddd7675c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb87c2046a44068ae97be5b47207e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:37:42Z,use_quota=True,user_id='5d9987f55b6d412b97836e97e0564936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(980ebb31-2ca1-47c7-a7e3-20be12bf93a3),volume_type_id=980ebb31-2ca1-47c7-a7e3-20be12bf93a3)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Creating volume 5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:37:41 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:37:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:41 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 1073741824 Sep 30 19:37:41 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:42 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 1073741824" returned: 0 in 0.744s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-3741e57b-f15e-47be-9b62-e8d93312ee97 req-f1fcee5e-8530-406f-b498-59a1a78f7de3 tempest-AttachVolumeShelveTestJSON-650824443 None] No connector for attachment 24680a78-e15e-46f1-a47f-70034279164c; skipping storage backend terminate_connection call. {{(pid=87426) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 30 19:37:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-3741e57b-f15e-47be-9b62-e8d93312ee97 req-f1fcee5e-8530-406f-b498-59a1a78f7de3 tempest-AttachVolumeShelveTestJSON-650824443 None] Deleting attachment 24680a78-e15e-46f1-a47f-70034279164c. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:37:42 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 Sep 30 19:37:42 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:43 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" returned: 0 in 0.403s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:37:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59ce65a-7392-429f-9f86-2068ae47dc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c851e30-7977-48ef-b481-1fba3fb49a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:37:43 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Volume volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 (5a8cc930-4e87-4ad4-a48a-f5ddd7675c07): created successfully Sep 30 19:37:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c851e30-7977-48ef-b481-1fba3fb49a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:37:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Flow 'volume_create_manager' (b6b06c80-ea43-4174-b386-8f8324c9e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:37:43 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2b57d457-dcef-4a55-bdeb-1c9c2954d6bc tempest-GroupSnapshotsTest-566213301 None] Created volume successfully. Sep 30 19:37:44 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] GroupSnapshot c6e03d6a-7b61-4c01-938c-01b8c227b146: creating. Sep 30 19:37:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Group snapshot c6e03d6a-7b61-4c01-938c-01b8c227b146: creating. {{(pid=87426) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 19:37:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Creating offline snapshot 1c1e61a7-fcfd-499b-8030-85abbdfaa96a of volume 5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:37:44 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[343fddb6-6fe8-4470-b39a-290aea6d64b8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:37:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:44 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 Sep 30 19:37:44 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:45 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" returned: 0 in 0.542s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:45 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a 1G Sep 30 19:37:45 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:45 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a 1G" returned: 0 in 0.649s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:45 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a Sep 30 19:37:45 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:46 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a" returned: 0 in 0.771s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:46 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:37:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:46 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a Sep 30 19:37:46 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:47 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a" returned: 0 in 0.463s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:47 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.info Sep 30 19:37:47 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:47 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-708db75e-26bd-423c-bc78-cd90be6f759d req-0e2619dd-1fe7-4e90-97ce-528818f243f3 tempest-AttachVolumeTestJSON-932163569 None] Terminate volume connection completed successfully. Sep 30 19:37:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-708db75e-26bd-423c-bc78-cd90be6f759d req-0e2619dd-1fe7-4e90-97ce-528818f243f3 tempest-AttachVolumeTestJSON-932163569 None] Deleting attachment b6829c9e-77dd-4809-9644-470457192971. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:37:47 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.info" returned: 0 in 0.463s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:47 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:37:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:47 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.info Sep 30 19:37:47 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:48 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.info" returned: 0 in 0.372s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.388s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-628ca6a9-c639-4cc0-b755-adea775ef8ea tempest-GroupSnapshotsTest-566213301 None] group_snapshot c6e03d6a-7b61-4c01-938c-01b8c227b146: created successfully Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-1c1e61a7-fcfd-499b-8030-85abbdfaa96a-5696706f-b409-4004-b3cd-25738ec8d30b" by "_create_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-1c1e61a7-fcfd-499b-8030-85abbdfaa96a-5696706f-b409-4004-b3cd-25738ec8d30b" acquired by "_create_volume_from_snapshot" :: waited 0.071s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Creating volume 5696706f-b409-4004-b3cd-25738ec8d30b from snapshot 1c1e61a7-fcfd-499b-8030-85abbdfaa96a {{(pid=87426) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:37:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-5696706f-b409-4004-b3cd-25738ec8d30b" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-5696706f-b409-4004-b3cd-25738ec8d30b" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] snapshot: 1c1e61a7-fcfd-499b-8030-85abbdfaa96a, volume: 5696706f-b409-4004-b3cd-25738ec8d30b, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d11655f-eb5c-439d-aac8-9b46f182e45a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:51 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a Sep 30 19:37:51 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:51 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a" returned: 0 in 0.818s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf40e78-43f9-4875-9b53-8103774ce562]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:37:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:52 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 Sep 30 19:37:52 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:37:52 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Sep 30 19:37:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" returned: 0 in 0.526s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:37:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:37:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:37:52 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:37:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:37:52 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b Sep 30 19:37:52 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:00 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:38:01 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:38:07 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b" returned: 0 in 14.836s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:07 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07, size 1024.00 MB, duration 14.84 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:38:07 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Converted 1024.00 MB image at 69.02 MB/s Sep 30 19:38:07 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:38:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:07 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b Sep 30 19:38:07 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:07 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b" returned: 0 in 0.425s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-5696706f-b409-4004-b3cd-25738ec8d30b" released by "_copy_volume_from_snapshot" :: held 16.807s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-1c1e61a7-fcfd-499b-8030-85abbdfaa96a-5696706f-b409-4004-b3cd-25738ec8d30b" released by "_create_volume_from_snapshot" :: held 16.956s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.028s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:08 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b93912c4-16f5-4312-963e-a84c3f2760a2 tempest-GroupSnapshotsTest-566213301 None] Create group from source-snapshot-c6e03d6a-7b61-4c01-938c-01b8c227b146 completed successfully. Sep 30 19:38:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-5696706f-b409-4004-b3cd-25738ec8d30b" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-5696706f-b409-4004-b3cd-25738ec8d30b" acquired by "delete_volume" :: waited 0.039s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:09 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eff3ca-f0b3-4491-88fb-890b4fb356a0]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:09 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b Sep 30 19:38:09 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:10 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b" returned: 0 in 0.542s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:10 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b Sep 30 19:38:10 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:10 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5696706f-b409-4004-b3cd-25738ec8d30b" returned: 0 in 0.353s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-5696706f-b409-4004-b3cd-25738ec8d30b" released by "delete_volume" :: held 0.984s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['fd14d9b1-62e1-4f28-aa8c-6d4a00aa6d7f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:10 devstack cinder-volume[87426]: WARNING cinder.quota [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1919482116 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1919482116, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:38:10 devstack cinder-volume[87426]: WARNING cinder.quota [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1919482116 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1919482116, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['f1534843-15c3-49cb-a655-e6c904073850', 'b216db79-0e4d-4418-983d-9bae047bc73d', '3d5e5877-f2a9-47ff-9ce5-0463c4918d5d', '6cf58b31-d986-4c32-be2a-3d8b5efb39a0'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:10 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:38:10 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:11 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.274s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:11 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:38:11 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-dca7f662-5e75-47ed-9572-3587d89722f9 tempest-GroupSnapshotsTest-566213301 None] Delete group completed successfully. Sep 30 19:38:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] group_snapshot c6e03d6a-7b61-4c01-938c-01b8c227b146: deleting Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] group_snapshot c6e03d6a-7b61-4c01-938c-01b8c227b146: deleting {{(pid=87426) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-1c1e61a7-fcfd-499b-8030-85abbdfaa96a" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-1c1e61a7-fcfd-499b-8030-85abbdfaa96a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Deleting offline snapshot 1c1e61a7-fcfd-499b-8030-85abbdfaa96a of volume 5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] snapshot_file for this snap is: volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2e0c00-9d8e-4ffd-a968-11ea42c5512a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:12 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a Sep 30 19:38:12 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:12 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a" returned: 0 in 0.448s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16fd11d-ffa3-4eb8-9580-65adc0285013]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:12 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 Sep 30 19:38:12 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:13 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" returned: 0 in 0.580s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:13 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a Sep 30 19:38:13 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:13 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a" returned: 0 in 0.321s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:13 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a Sep 30 19:38:13 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:13 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07.1c1e61a7-fcfd-499b-8030-85abbdfaa96a" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-1c1e61a7-fcfd-499b-8030-85abbdfaa96a" released by "_delete_snapshot" :: held 1.734s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" released by "delete_snapshot" :: held 1.760s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:13 devstack cinder-volume[87426]: WARNING cinder.quota [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1919482116 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1919482116, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:38:13 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['d8371d45-41e7-4169-94c9-7cc5fb2c8321', '91126c06-1474-4463-8a0a-0e25be0dd8e4', '2e20fb4d-2d10-4146-a926-37b760026f01', '868fece4-91e7-4dfd-9f96-ee2dd8fedb4f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:14 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-536605ce-20e3-4d8b-9c06-39abbf6b6516 tempest-GroupSnapshotsTest-566213301 None] group_snapshot c6e03d6a-7b61-4c01-938c-01b8c227b146: deleted successfully Sep 30 19:38:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:14 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa483cc-4a52-4952-bd28-d7c5b372823a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:15 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 Sep 30 19:38:15 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:15 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" returned: 0 in 0.479s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:15 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07 Sep 30 19:38:15 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:15 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" returned: 0 in 0.290s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-5a8cc930-4e87-4ad4-a48a-f5ddd7675c07" released by "delete_volume" :: held 0.898s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['ab2725d9-3ddc-45e9-aef9-06c411b55527'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:15 devstack cinder-volume[87426]: WARNING cinder.db.api [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1919482116'] Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['db5d97d0-091c-4a21-9b1f-abdd3d480f41', 'b76f1756-e633-4c6d-8a9b-76ff39251ff5', 'fd441f94-59ad-4e6c-ac22-6ef88db9ee83', '37ff1da1-b7d8-4fee-9b18-fe34b727bdf6'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:15 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:38:15 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Flow 'volume_create_manager' (28a6063e-59e5-45c2-aafe-59a075510c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0a1a19-1368-4b1a-b657-afdfbddaaede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0a1a19-1368-4b1a-b657-afdfbddaaede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-90434720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e587424194d4a61bb01f91a841779f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:16Z,use_quota=True,user_id='9ded284ee0de4838a1c1dda11ac45f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79488bf7-c849-4bbf-a326-75299bba5fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79488bf7-c849-4bbf-a326-75299bba5fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4f1286-5820-42da-bea7-503d3896d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4f1286-5820-42da-bea7-503d3896d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa', 'volume_name': 'volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39b4b37-9b84-4d77-b01c-5059a571c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39b4b37-9b84-4d77-b01c-5059a571c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b59118-fe77-4bb6-a607-fbad203f08e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:16 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Volume e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa', 'volume_size': 1} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-90434720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e587424194d4a61bb01f91a841779f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:16Z,use_quota=True,user_id='9ded284ee0de4838a1c1dda11ac45f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Creating volume e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:38:16 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:16 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa 1073741824 Sep 30 19:38:16 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:16 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.450s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:38:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b804529f-f61b-4c8b-86bc-b24eed707590 tempest-GroupSnapshotsTest-566213301 None] Delete group completed successfully. Sep 30 19:38:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ad4dc138-36ff-4d42-b789-bc77d497efe0 tempest-GroupSnapshotsTest-566213301 None] Group tempest-GroupSnapshotsTest-Group-1597111180: creating Sep 30 19:38:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ad4dc138-36ff-4d42-b789-bc77d497efe0 tempest-GroupSnapshotsTest-566213301 None] Group tempest-GroupSnapshotsTest-Group-1597111180: created successfully Sep 30 19:38:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ad4dc138-36ff-4d42-b789-bc77d497efe0 tempest-GroupSnapshotsTest-566213301 None] Create group completed successfully. Sep 30 19:38:16 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa 1073741824" returned: 0 in 0.738s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:16 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa Sep 30 19:38:16 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:17 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa" returned: 0 in 0.323s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:38:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b59118-fe77-4bb6-a607-fbad203f08e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c63100-3279-46e5-9a48-78f5506a8288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:17 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Volume volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa (e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa): created successfully Sep 30 19:38:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c63100-3279-46e5-9a48-78f5506a8288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Flow 'volume_create_manager' (28a6063e-59e5-45c2-aafe-59a075510c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:17 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-40bd56d2-c0bb-4a77-8963-c9950b7452b1 tempest-ServerActionsTestOtherA-178048750 None] Created volume successfully. Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Flow 'volume_create_manager' (57083b03-5ec7-4285-9d6a-b58f4518e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75369026-834f-4b06-b308-c5c8a61efddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75369026-834f-4b06-b308-c5c8a61efddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-548361900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e67cf250-05de-44cd-a039-9136e9bdd032,host='devstack@QuobyteHD#QuobyteHD',id=57412ef7-8863-4267-8b68-6bc705540ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb87c2046a44068ae97be5b47207e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:18Z,use_quota=True,user_id='5d9987f55b6d412b97836e97e0564936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a662357f-a2c4-4fa9-813c-07229f92660a),volume_type_id=a662357f-a2c4-4fa9-813c-07229f92660a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80feb7d2-eb7d-4bbe-a45e-314a7f7e7d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80feb7d2-eb7d-4bbe-a45e-314a7f7e7d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606a8799-4c28-4ef8-9cde-93c21cdbdb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606a8799-4c28-4ef8-9cde-93c21cdbdb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57412ef7-8863-4267-8b68-6bc705540ded', 'volume_name': 'volume-57412ef7-8863-4267-8b68-6bc705540ded', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504cc791-1110-46c1-a725-8917854beee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504cc791-1110-46c1-a725-8917854beee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcebcb7b-8ed4-463e-8372-31a1521fc02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:18 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Volume 57412ef7-8863-4267-8b68-6bc705540ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57412ef7-8863-4267-8b68-6bc705540ded', 'volume_size': 1} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e67cf250-05de-44cd-a039-9136e9bdd032,created_at=2026-09-30T17:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-548361900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e67cf250-05de-44cd-a039-9136e9bdd032,host='devstack@QuobyteHD#QuobyteHD',id=57412ef7-8863-4267-8b68-6bc705540ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb87c2046a44068ae97be5b47207e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:18Z,use_quota=True,user_id='5d9987f55b6d412b97836e97e0564936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a662357f-a2c4-4fa9-813c-07229f92660a),volume_type_id=a662357f-a2c4-4fa9-813c-07229f92660a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Creating volume 57412ef7-8863-4267-8b68-6bc705540ded {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:38:18 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:38:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:18 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded 1073741824 Sep 30 19:38:18 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:19 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded 1073741824" returned: 0 in 0.459s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:19 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded Sep 30 19:38:19 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:19 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded" returned: 0 in 0.300s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:38:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcebcb7b-8ed4-463e-8372-31a1521fc02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57412ef7-8863-4267-8b68-6bc705540ded', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be23a48d-a11b-4e8f-a1ee-a2b014a19d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:19 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Volume volume-57412ef7-8863-4267-8b68-6bc705540ded (57412ef7-8863-4267-8b68-6bc705540ded): created successfully Sep 30 19:38:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be23a48d-a11b-4e8f-a1ee-a2b014a19d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Flow 'volume_create_manager' (57083b03-5ec7-4285-9d6a-b58f4518e66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:19 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b6c0eae9-e0ed-4cd6-837c-25f3a9016103 tempest-GroupSnapshotsTest-566213301 None] Created volume successfully. Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Flow 'volume_create_manager' (def93877-be22-4cda-b02b-133bddc4db9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5add8487-07a7-4cbd-ab4d-d21b95a44237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5add8487-07a7-4cbd-ab4d-d21b95a44237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1619745978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e67cf250-05de-44cd-a039-9136e9bdd032,host='devstack@QuobyteHD#QuobyteHD',id=723d8e33-64ba-421c-a1b5-74b72374cc4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb87c2046a44068ae97be5b47207e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:20Z,use_quota=True,user_id='5d9987f55b6d412b97836e97e0564936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a662357f-a2c4-4fa9-813c-07229f92660a),volume_type_id=a662357f-a2c4-4fa9-813c-07229f92660a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d555c06c-7076-4fac-ab90-d57b44a8775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d555c06c-7076-4fac-ab90-d57b44a8775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db6bd60-2871-4b40-a8de-02c680141c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db6bd60-2871-4b40-a8de-02c680141c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '723d8e33-64ba-421c-a1b5-74b72374cc4e', 'volume_name': 'volume-723d8e33-64ba-421c-a1b5-74b72374cc4e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a34e504-cfc7-47c3-ac55-b3b1d404d1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a34e504-cfc7-47c3-ac55-b3b1d404d1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826e38b7-9b83-434e-9fd7-902a5f51feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:20 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Volume 723d8e33-64ba-421c-a1b5-74b72374cc4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-723d8e33-64ba-421c-a1b5-74b72374cc4e', 'volume_size': 1} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e67cf250-05de-44cd-a039-9136e9bdd032,created_at=2026-09-30T17:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1619745978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e67cf250-05de-44cd-a039-9136e9bdd032,host='devstack@QuobyteHD#QuobyteHD',id=723d8e33-64ba-421c-a1b5-74b72374cc4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb87c2046a44068ae97be5b47207e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:20Z,use_quota=True,user_id='5d9987f55b6d412b97836e97e0564936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a662357f-a2c4-4fa9-813c-07229f92660a),volume_type_id=a662357f-a2c4-4fa9-813c-07229f92660a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Creating volume 723d8e33-64ba-421c-a1b5-74b72374cc4e {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:38:20 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:38:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:20 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e 1073741824 Sep 30 19:38:20 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:21 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e 1073741824" returned: 0 in 0.613s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:21 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e Sep 30 19:38:21 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:21 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e" returned: 0 in 0.293s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:38:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826e38b7-9b83-434e-9fd7-902a5f51feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-723d8e33-64ba-421c-a1b5-74b72374cc4e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680e553e-f3c9-4458-962d-cd8357cf62a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:21 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Volume volume-723d8e33-64ba-421c-a1b5-74b72374cc4e (723d8e33-64ba-421c-a1b5-74b72374cc4e): created successfully Sep 30 19:38:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680e553e-f3c9-4458-962d-cd8357cf62a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Flow 'volume_create_manager' (def93877-be22-4cda-b02b-133bddc4db9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:21 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d0450c9a-cc1b-4fa3-b143-7b8db79ec81e tempest-GroupSnapshotsTest-566213301 None] Created volume successfully. Sep 30 19:38:23 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b2197c3d-9160-4ddc-b3da-b447d7c2ccb7 tempest-GroupSnapshotsTest-566213301 None] Update group completed successfully. Sep 30 19:38:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:38:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:23 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:38:23 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:24 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.418s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:38:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:38:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 8 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:38:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:38:24 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2c9c1b9d-f073-4d21-8c6b-8a67c24f9f81 tempest-GroupSnapshotsTest-566213301 None] Update group completed successfully. Sep 30 19:38:25 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c5ec89c5-07ef-494a-bccb-6becad7a3711 tempest-GroupSnapshotsTest-566213301 None] Update group completed successfully. Sep 30 19:38:26 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a8d9dd71-ef93-405e-b000-3be2a78d1c78 tempest-GroupSnapshotsTest-566213301 None] Update group completed successfully. Sep 30 19:38:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] GroupSnapshot 3982c6b5-77e2-45e5-afcc-1ae4d92732d9: creating. Sep 30 19:38:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Group snapshot 3982c6b5-77e2-45e5-afcc-1ae4d92732d9: creating. {{(pid=87426) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 19:38:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Creating offline snapshot 2eed86dc-bc1e-47ad-b1b4-64d1e331e340 of volume 723d8e33-64ba-421c-a1b5-74b72374cc4e {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:38:28 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fda5001-f659-45ef-b261-932166f6ff06]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:28 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e Sep 30 19:38:28 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:29 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e" returned: 0 in 0.482s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:29 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 1G Sep 30 19:38:29 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:29 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 1G" returned: 0 in 0.546s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-723d8e33-64ba-421c-a1b5-74b72374cc4e -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:29 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-723d8e33-64ba-421c-a1b5-74b72374cc4e -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 Sep 30 19:38:29 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:29 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-723d8e33-64ba-421c-a1b5-74b72374cc4e -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340" returned: 0 in 0.292s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:29 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:38:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:29 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 Sep 30 19:38:29 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:30 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340" returned: 0 in 0.267s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:30 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.info Sep 30 19:38:30 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:30 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.info" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:30 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:30 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.info Sep 30 19:38:30 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:30 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.info" returned: 0 in 0.264s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Creating offline snapshot efd9e97a-6c72-469b-ade6-c9812655d238 of volume 57412ef7-8863-4267-8b68-6bc705540ded {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[93676a8f-245a-4533-8efb-88976dc96074]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:30 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded Sep 30 19:38:30 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:31 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded" returned: 0 in 0.385s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:31 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 1G Sep 30 19:38:31 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:31 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 1G" returned: 0 in 0.502s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57412ef7-8863-4267-8b68-6bc705540ded -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:31 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57412ef7-8863-4267-8b68-6bc705540ded -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 Sep 30 19:38:31 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:32 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57412ef7-8863-4267-8b68-6bc705540ded -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238" returned: 0 in 0.336s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:32 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:38:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:32 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 Sep 30 19:38:32 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:32 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238" returned: 0 in 0.519s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:32 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.info Sep 30 19:38:32 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:32 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.info" returned: 0 in 0.323s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:32 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:38:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:32 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.info Sep 30 19:38:32 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:33 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.info" returned: 0 in 0.312s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:33 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-aa2c6924-caa7-4edc-8fec-ec3147709de5 tempest-GroupSnapshotsTest-566213301 None] group_snapshot 3982c6b5-77e2-45e5-afcc-1ae4d92732d9: created successfully Sep 30 19:38:34 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] group_snapshot 3982c6b5-77e2-45e5-afcc-1ae4d92732d9: deleting Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] group_snapshot 3982c6b5-77e2-45e5-afcc-1ae4d92732d9: deleting {{(pid=87426) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-723d8e33-64ba-421c-a1b5-74b72374cc4e" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-723d8e33-64ba-421c-a1b5-74b72374cc4e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-2eed86dc-bc1e-47ad-b1b4-64d1e331e340" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-2eed86dc-bc1e-47ad-b1b4-64d1e331e340" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Deleting offline snapshot 2eed86dc-bc1e-47ad-b1b4-64d1e331e340 of volume 723d8e33-64ba-421c-a1b5-74b72374cc4e {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] snapshot_file for this snap is: volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e10bbf-15d4-4842-ab2e-c5479513b25b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:34 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 Sep 30 19:38:34 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:34 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340" returned: 0 in 0.598s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-723d8e33-64ba-421c-a1b5-74b72374cc4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[acca2a29-80a3-41c8-a89a-4c93e2f054e4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:35 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e Sep 30 19:38:35 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:35 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e" returned: 0 in 0.421s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:35 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 Sep 30 19:38:35 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:35 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340" returned: 0 in 0.332s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:35 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340 Sep 30 19:38:35 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:35 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e.2eed86dc-bc1e-47ad-b1b4-64d1e331e340" returned: 0 in 0.274s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-2eed86dc-bc1e-47ad-b1b4-64d1e331e340" released by "_delete_snapshot" :: held 1.846s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-723d8e33-64ba-421c-a1b5-74b72374cc4e" released by "delete_snapshot" :: held 1.888s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-57412ef7-8863-4267-8b68-6bc705540ded" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-57412ef7-8863-4267-8b68-6bc705540ded" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-efd9e97a-6c72-469b-ade6-c9812655d238" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-efd9e97a-6c72-469b-ade6-c9812655d238" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Deleting offline snapshot efd9e97a-6c72-469b-ade6-c9812655d238 of volume 57412ef7-8863-4267-8b68-6bc705540ded {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] snapshot_file for this snap is: volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc22e4c4-4671-4c7f-aad6-d9450ed11cfd]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:36 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 Sep 30 19:38:36 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:36 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238" returned: 0 in 0.398s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57412ef7-8863-4267-8b68-6bc705540ded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[183cdf17-943c-4994-aaf0-d89ab5d9afcd]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:36 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded Sep 30 19:38:36 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Acquiring lock "cinder-5d4f4455-8b1f-4690-a880-bf3236034bf7-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "cinder-5d4f4455-8b1f-4690-a880-bf3236034bf7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Acquiring lock "cinder-quobyte-5d4f4455-8b1f-4690-a880-bf3236034bf7" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "cinder-quobyte-5d4f4455-8b1f-4690-a880-bf3236034bf7" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a46c52-5ada-491c-aeeb-be9571484af6]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:37 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded" returned: 0 in 0.450s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:37 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 Sep 30 19:38:37 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:37 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 Sep 30 19:38:37 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:37 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7" returned: 0 in 0.426s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:37 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7 Sep 30 19:38:37 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:37 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238" returned: 0 in 0.411s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:37 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238 Sep 30 19:38:37 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:37 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d4f4455-8b1f-4690-a880-bf3236034bf7" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "cinder-quobyte-5d4f4455-8b1f-4690-a880-bf3236034bf7" released by "delete_volume" :: held 0.753s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Created reservations ['665685c3-7cdf-4520-b0dc-0b2640cb5a64', 'e0813842-5ae2-476d-8569-a20827aefa52', '757e5115-cb2a-4db4-aa4a-58748e4d6f16', '0d48ca6e-d6f5-4e16-bce8-5529e102adeb'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:37 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded.efd9e97a-6c72-469b-ade6-c9812655d238" returned: 0 in 0.277s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-efd9e97a-6c72-469b-ade6-c9812655d238" released by "_delete_snapshot" :: held 1.656s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-57412ef7-8863-4267-8b68-6bc705540ded" released by "delete_snapshot" :: held 1.689s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:37 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:38:37 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:37 devstack cinder-volume[87426]: WARNING cinder.quota [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-902274366 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-902274366, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:38:37 devstack cinder-volume[87426]: WARNING cinder.quota [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-902274366 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-902274366, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:38:37 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Created reservations ['f0573486-f215-4a90-b188-3a323941b7e9', 'bb7e3ac9-90db-4d7b-adca-56f616be7971', '48e028c3-0c90-420e-89f6-7cdcf568fc33', '3dee30e1-2295-4b75-9ebf-225175cb0736'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:38 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] Created reservations ['1e3a981e-ed99-4a9f-ae6f-26dc431cd22f', 'a73486f8-82ce-4351-bb0c-9e577e0a588c', 'd7ff0338-46bd-4ed5-859d-a0356b3cdc25', '4c3f7d3d-9a35-4350-9a43-960090f36e3a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:38 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3c8a3425-4de2-4015-a344-fb49cc78b13d tempest-GroupSnapshotsTest-566213301 None] group_snapshot 3982c6b5-77e2-45e5-afcc-1ae4d92732d9: deleted successfully Sep 30 19:38:38 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.385s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:38 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:38:38 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Deleted volume successfully. Sep 30 19:38:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-14a5cb50-cc34-4bc8-991e-18c27dc8962e tempest-AttachVolumeShelveTestJSON-650824443 None] Lock "cinder-5d4f4455-8b1f-4690-a880-bf3236034bf7-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-57412ef7-8863-4267-8b68-6bc705540ded" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-57412ef7-8863-4267-8b68-6bc705540ded" acquired by "delete_volume" :: waited 0.039s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:39 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa4e21a-b2ba-4b01-9497-568c4344c71f]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:39 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded Sep 30 19:38:39 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:39 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded" returned: 0 in 0.488s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:39 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded Sep 30 19:38:39 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:40 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-57412ef7-8863-4267-8b68-6bc705540ded" returned: 0 in 0.289s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-57412ef7-8863-4267-8b68-6bc705540ded" released by "delete_volume" :: held 0.891s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-723d8e33-64ba-421c-a1b5-74b72374cc4e" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-723d8e33-64ba-421c-a1b5-74b72374cc4e" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:40 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0736a5ec-0acb-4a72-b549-03f630951a5b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:40 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e Sep 30 19:38:40 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:40 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e" returned: 0 in 0.426s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:40 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e Sep 30 19:38:40 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:40 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-723d8e33-64ba-421c-a1b5-74b72374cc4e" returned: 0 in 0.246s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-723d8e33-64ba-421c-a1b5-74b72374cc4e" released by "delete_volume" :: held 0.783s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['799b6463-4c35-46c7-99c8-61612a0748c0'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:41 devstack cinder-volume[87426]: WARNING cinder.quota [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-902274366 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-902274366, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['45b855f7-9502-481f-ae18-8b2a69be4df6', 'b6930a1b-2b48-4117-8d53-f2213e7daaab', 'c470ad9d-2737-4819-9510-d3f668ff06dd', 'd661c12f-5bd0-4c57-b28c-957afddcd17a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['299284c8-2d5b-4160-8083-b288596e33c5', 'ef8d0e30-f65e-4c78-8957-3f4590d33ac1', '72524f5b-0603-4a86-aae4-4d38494d8405', '82fd928d-5cc9-40cf-b4af-1c9bdd82f77b'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:41 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:38:41 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:41 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.320s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:41 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:38:41 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0d5a60d1-d8bc-4202-90b7-6c3236a142b5 tempest-GroupSnapshotsTest-566213301 None] Delete group completed successfully. Sep 30 19:38:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-dd7a3fbe-ae5a-42f9-86b2-0618bb914869 tempest-GroupSnapshotsTest-566213301 None] Group tempest-GroupSnapshotsTest-Group-1129681838: creating Sep 30 19:38:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-dd7a3fbe-ae5a-42f9-86b2-0618bb914869 tempest-GroupSnapshotsTest-566213301 None] Group tempest-GroupSnapshotsTest-Group-1129681838: created successfully Sep 30 19:38:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-dd7a3fbe-ae5a-42f9-86b2-0618bb914869 tempest-GroupSnapshotsTest-566213301 None] Create group completed successfully. Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Flow 'volume_create_manager' (dd9c7ecb-ea17-4211-976f-c559edeb0db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dc79c3-5687-495e-841c-c5613e30c74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dc79c3-5687-495e-841c-c5613e30c74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173539889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7aab3bb-4ecb-4a90-b7d6-fa3b89c7bad6,host='devstack@QuobyteHD#QuobyteHD',id=6e0c7193-8f9d-4c62-bb6f-c451fcb4beba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb87c2046a44068ae97be5b47207e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:44Z,use_quota=True,user_id='5d9987f55b6d412b97836e97e0564936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a49eb486-dcdd-4e36-b1b0-86af767fe4f9),volume_type_id=a49eb486-dcdd-4e36-b1b0-86af767fe4f9)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bef6cc-fbb8-425e-ab7b-ef3552f3eabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bef6cc-fbb8-425e-ab7b-ef3552f3eabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ce8550-7e70-41ba-862f-1289a0c10b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ce8550-7e70-41ba-862f-1289a0c10b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0c7193-8f9d-4c62-bb6f-c451fcb4beba', 'volume_name': 'volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4407ee0f-f217-4fbc-a1d2-c0315d2beaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4407ee0f-f217-4fbc-a1d2-c0315d2beaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5083f2-0531-4cb8-b70f-5ff368fc4d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:44 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Volume 6e0c7193-8f9d-4c62-bb6f-c451fcb4beba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba', 'volume_size': 1} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7aab3bb-4ecb-4a90-b7d6-fa3b89c7bad6,created_at=2026-09-30T17:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173539889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7aab3bb-4ecb-4a90-b7d6-fa3b89c7bad6,host='devstack@QuobyteHD#QuobyteHD',id=6e0c7193-8f9d-4c62-bb6f-c451fcb4beba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb87c2046a44068ae97be5b47207e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:44Z,use_quota=True,user_id='5d9987f55b6d412b97836e97e0564936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a49eb486-dcdd-4e36-b1b0-86af767fe4f9),volume_type_id=a49eb486-dcdd-4e36-b1b0-86af767fe4f9)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Creating volume 6e0c7193-8f9d-4c62-bb6f-c451fcb4beba {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:38:44 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:44 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba 1073741824 Sep 30 19:38:44 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:44 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba 1073741824" returned: 0 in 0.534s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:44 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba Sep 30 19:38:44 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:45 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" returned: 0 in 0.340s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:38:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5083f2-0531-4cb8-b70f-5ff368fc4d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870789e0-f1a3-4e16-86de-4253c6cc9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:45 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Volume volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba (6e0c7193-8f9d-4c62-bb6f-c451fcb4beba): created successfully Sep 30 19:38:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870789e0-f1a3-4e16-86de-4253c6cc9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Flow 'volume_create_manager' (dd9c7ecb-ea17-4211-976f-c559edeb0db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-19a10200-2a38-44ee-9800-7d8c51ee3d0b tempest-GroupSnapshotsTest-566213301 None] Created volume successfully. Sep 30 19:38:46 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] GroupSnapshot 0e81bdaf-8a6e-4204-961d-03873a20afb4: creating. Sep 30 19:38:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Group snapshot 0e81bdaf-8a6e-4204-961d-03873a20afb4: creating. {{(pid=87426) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 19:38:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Creating offline snapshot e0d3ef1e-65c7-4a2d-9f68-9773618328ee of volume 6e0c7193-8f9d-4c62-bb6f-c451fcb4beba {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:38:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e707e943-3a05-403d-9ef4-d8ac5a899b84]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:46 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba Sep 30 19:38:46 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:47 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" returned: 0 in 0.434s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:47 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee 1G Sep 30 19:38:47 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Flow 'volume_create_manager' (c45077e2-7fcb-43ed-a6c3-5dfa6258f846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1744f97f-847b-4f7b-8df9-c71c60e38da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1744f97f-847b-4f7b-8df9-c71c60e38da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-264003364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8328454d-df55-463a-ae8f-7596a327fd33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='528f7de3be044f74aff2fec6dc9320d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:48Z,use_quota=True,user_id='d6a49839d5024b67927507b655f82cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fb5dc6-91b6-4291-bfaf-3fd19ad6451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fb5dc6-91b6-4291-bfaf-3fd19ad6451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4138c9e-89d8-477a-9213-d40c6e6daa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4138c9e-89d8-477a-9213-d40c6e6daa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8328454d-df55-463a-ae8f-7596a327fd33', 'volume_name': 'volume-8328454d-df55-463a-ae8f-7596a327fd33', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffd3995-5929-4e1e-b6ee-f52e828971ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffd3995-5929-4e1e-b6ee-f52e828971ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b16e776-b1f4-4ccb-a932-205e228a5015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:47 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Volume 8328454d-df55-463a-ae8f-7596a327fd33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8328454d-df55-463a-ae8f-7596a327fd33', 'volume_size': 1} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:47 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee 1G" returned: 0 in 0.561s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:47 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee Sep 30 19:38:47 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:48 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee" returned: 0 in 0.322s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:48 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:38:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:48 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee Sep 30 19:38:48 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:48 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee" returned: 0 in 0.299s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:48 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.info Sep 30 19:38:48 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:48 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.info" returned: 0 in 0.325s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:48 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:38:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:48 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.info Sep 30 19:38:48 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:49 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.info" returned: 0 in 0.319s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.373s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-264003364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8328454d-df55-463a-ae8f-7596a327fd33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='528f7de3be044f74aff2fec6dc9320d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:38:48Z,use_quota=True,user_id='d6a49839d5024b67927507b655f82cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Creating volume 8328454d-df55-463a-ae8f-7596a327fd33 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:38:49 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:49 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33 1073741824 Sep 30 19:38:49 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:49 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1ffc0a27-080a-4444-98cf-b2b57f9e453b tempest-GroupSnapshotsTest-566213301 None] group_snapshot 0e81bdaf-8a6e-4204-961d-03873a20afb4: created successfully Sep 30 19:38:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-1f937983-4d8e-4971-b1f5-7be69826f21b req-755eda80-1005-4f47-b9fd-cc389a213d8e tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:50 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33 1073741824" returned: 0 in 0.771s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:50 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33 Sep 30 19:38:50 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:50 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] group_snapshot 0e81bdaf-8a6e-4204-961d-03873a20afb4: deleting Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] group_snapshot 0e81bdaf-8a6e-4204-961d-03873a20afb4: deleting {{(pid=87426) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 19:38:50 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33" returned: 0 in 0.288s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-1f937983-4d8e-4971-b1f5-7be69826f21b req-755eda80-1005-4f47-b9fd-cc389a213d8e tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.365s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b16e776-b1f4-4ccb-a932-205e228a5015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8328454d-df55-463a-ae8f-7596a327fd33', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc4b7e3-d490-41d4-a1af-ae02e185b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:38:50 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Volume volume-8328454d-df55-463a-ae8f-7596a327fd33 (8328454d-df55-463a-ae8f-7596a327fd33): created successfully Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc4b7e3-d490-41d4-a1af-ae02e185b649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Flow 'volume_create_manager' (c45077e2-7fcb-43ed-a6c3-5dfa6258f846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-e0d3ef1e-65c7-4a2d-9f68-9773618328ee" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:50 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-a6f604ee-cbb3-4c48-b34b-2bac2b82231f req-0baae0d6-665b-4c5a-bf1b-3893dd260d98 tempest-VolumesGetTestJSON-427890450 None] Created volume successfully. Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-1f937983-4d8e-4971-b1f5-7be69826f21b req-755eda80-1005-4f47-b9fd-cc389a213d8e tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.144s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-e0d3ef1e-65c7-4a2d-9f68-9773618328ee" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Deleting offline snapshot e0d3ef1e-65c7-4a2d-9f68-9773618328ee of volume 6e0c7193-8f9d-4c62-bb6f-c451fcb4beba {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] snapshot_file for this snap is: volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-1f937983-4d8e-4971-b1f5-7be69826f21b req-755eda80-1005-4f47-b9fd-cc389a213d8e tempest-ServerActionsTestOtherA-178048750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03b57c54-c667-4064-a32b-6e429b35d545', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ec76b6-63ef-4383-9521-74b8bd34a52b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:50 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-1f937983-4d8e-4971-b1f5-7be69826f21b req-755eda80-1005-4f47-b9fd-cc389a213d8e tempest-ServerActionsTestOtherA-178048750 None] attachment_update completed successfully. Sep 30 19:38:50 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee Sep 30 19:38:50 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:51 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee" returned: 0 in 0.445s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f29c721-7b69-4863-baf7-a174f0303bce]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:51 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba Sep 30 19:38:51 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Acquiring lock "cinder-8328454d-df55-463a-ae8f-7596a327fd33-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Lock "cinder-8328454d-df55-463a-ae8f-7596a327fd33-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Acquiring lock "cinder-quobyte-8328454d-df55-463a-ae8f-7596a327fd33" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Lock "cinder-quobyte-8328454d-df55-463a-ae8f-7596a327fd33" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:51 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" returned: 0 in 0.652s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10975a3-b683-4d81-9bc5-ead714dd2e16]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:51 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee Sep 30 19:38:51 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:51 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33 Sep 30 19:38:51 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:52 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee" returned: 0 in 0.436s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:52 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33" returned: 0 in 0.432s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:52 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee Sep 30 19:38:52 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:52 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33 Sep 30 19:38:52 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:52 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8328454d-df55-463a-ae8f-7596a327fd33" returned: 0 in 0.491s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Lock "cinder-quobyte-8328454d-df55-463a-ae8f-7596a327fd33" released by "delete_volume" :: held 1.006s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:52 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba.e0d3ef1e-65c7-4a2d-9f68-9773618328ee" returned: 0 in 0.571s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-e0d3ef1e-65c7-4a2d-9f68-9773618328ee" released by "_delete_snapshot" :: held 2.270s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" released by "delete_snapshot" :: held 2.338s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:52 devstack cinder-volume[87426]: DEBUG cinder.quota [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Created reservations ['e1a9e404-1dc0-4767-9da5-f837f491cbac', '7fa93d64-9e8e-40e9-aeee-8e743ab40e43', 'ed944e81-8d53-40f1-95d5-f3a045745aed', '378af5e5-706c-4deb-ae31-ccd567a50e1b'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:52 devstack cinder-volume[87426]: WARNING cinder.quota [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-234139967 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-234139967, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:38:53 devstack cinder-volume[87426]: WARNING cinder.quota [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-234139967 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-234139967, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] Created reservations ['af76e50c-cfce-48e0-b80b-4dd29b71b123', '25e39785-3ff3-4e38-94ed-c18edea819c8', 'a9627ced-cd21-4450-890d-dec907586b8b', '6031f2aa-5c4d-4632-b941-5fd79eaf80eb'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:53 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:38:53 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f82c308f-12ba-4bd2-93a9-b1cbeff1255d tempest-GroupSnapshotsTest-566213301 None] group_snapshot 0e81bdaf-8a6e-4204-961d-03873a20afb4: deleted successfully Sep 30 19:38:53 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.450s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG cinder.manager [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:38:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Deleted volume successfully. Sep 30 19:38:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-fb79d7b0-6113-4442-981d-207fc918bd56 req-4c4df4fa-b105-42d9-983f-daab9ff1449d tempest-VolumesGetTestJSON-427890450 None] Lock "cinder-8328454d-df55-463a-ae8f-7596a327fd33-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "cinder-quobyte-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:38:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:38:54 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d83b22-c0ed-40f0-98bd-0e9c2459525a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:38:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:54 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba Sep 30 19:38:54 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:54 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" returned: 0 in 0.613s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:54 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba Sep 30 19:38:54 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" returned: 0 in 0.307s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:55 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Lock "cinder-quobyte-6e0c7193-8f9d-4c62-bb6f-c451fcb4beba" released by "delete_volume" :: held 1.088s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['2cd3aa18-30af-4b44-8728-805c6e632aa0'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:55 devstack cinder-volume[87426]: WARNING cinder.quota [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-234139967 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-234139967, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Created reservations ['630b4a43-0ff2-4879-bee1-0fb7e517c926', '42549a8a-e8cd-4177-b771-305f2ad6deca', '04eea0d4-f690-4d46-8cff-cc17ca94d44d', 'cc0dffae-54cf-4e42-8b8f-56de52e309cd'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:38:55 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:38:55 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:38:56 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Sep 30 19:38:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.428s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:38:56 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:38:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-049c29f1-be7b-47ed-b219-3457105b0135 tempest-GroupSnapshotsTest-566213301 None] Delete group completed successfully. Sep 30 19:38:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-54ea25cd-fa11-476c-9987-3822fd712795 req-b40b2756-fef1-4bc3-8e75-8158dc508026 tempest-ServerActionsTestOtherA-178048750 None] Terminate volume connection completed successfully. Sep 30 19:38:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-54ea25cd-fa11-476c-9987-3822fd712795 req-b40b2756-fef1-4bc3-8e75-8158dc508026 tempest-ServerActionsTestOtherA-178048750 None] Deleting attachment 03b57c54-c667-4064-a32b-6e429b35d545. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:38:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-54ea25cd-fa11-476c-9987-3822fd712795 req-c945d941-4583-4430-a070-93adf9d2acae tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:38:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-54ea25cd-fa11-476c-9987-3822fd712795 req-c945d941-4583-4430-a070-93adf9d2acae tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:38:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-54ea25cd-fa11-476c-9987-3822fd712795 req-c945d941-4583-4430-a070-93adf9d2acae tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:38:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-54ea25cd-fa11-476c-9987-3822fd712795 req-c945d941-4583-4430-a070-93adf9d2acae tempest-ServerActionsTestOtherA-178048750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c46dc759-e095-4d7b-98b1-3dc4005a5e2e', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:38:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-54ea25cd-fa11-476c-9987-3822fd712795 req-c945d941-4583-4430-a070-93adf9d2acae tempest-ServerActionsTestOtherA-178048750 None] attachment_update completed successfully. Sep 30 19:39:07 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=138,cinder:UPDATE=127,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:39:07 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:INSERT=34,cinder:SELECT=121,cinder:UPDATE=127,cinder:DELETE=2 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:39:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-478c7219-434d-4c8b-a435-11e88f8c123e tempest-GroupSnapshotsV319Test-1124839950 None] Group tempest-GroupSnapshotsV319Test-Group-403607688: creating Sep 30 19:39:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-478c7219-434d-4c8b-a435-11e88f8c123e tempest-GroupSnapshotsV319Test-1124839950 None] Group tempest-GroupSnapshotsV319Test-Group-403607688: created successfully Sep 30 19:39:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-478c7219-434d-4c8b-a435-11e88f8c123e tempest-GroupSnapshotsV319Test-1124839950 None] Create group completed successfully. Sep 30 19:39:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-47749033-f96e-447d-ab84-cd0ea7a267eb tempest-BackendsCapabilitiesAdminTestsJSON-1685326244 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8975448608398, 'free_capacity_gb': 1774.8975448608398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87426) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 30 19:39:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9986a6d8-91ee-49d5-b22a-2e8bf1ad4ef7 tempest-BackendsCapabilitiesAdminTestsJSON-1685326244 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8975448608398, 'free_capacity_gb': 1774.8975448608398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87426) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Flow 'volume_create_manager' (c502eff6-17df-446d-ba5f-63888f09b97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097c7448-22de-4737-a517-f53a0c1fb573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (097c7448-22de-4737-a517-f53a0c1fb573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77102200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7efad5d-31e5-4aa0-9096-9c358b3831a8,host='devstack@QuobyteHD#QuobyteHD',id=a52ebc59-dd13-4399-b446-391346c20312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5223407cd04002a5f402b8af7ddfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:11Z,use_quota=True,user_id='9a80223d899f4780951a3311828d6ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8697985-dc8d-43ae-8cf2-292805425c77),volume_type_id=a8697985-dc8d-43ae-8cf2-292805425c77)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431d7c11-9cca-451d-80f9-66a3b4922fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431d7c11-9cca-451d-80f9-66a3b4922fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba5371b-abca-4d60-a253-1442ffe690ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba5371b-abca-4d60-a253-1442ffe690ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a52ebc59-dd13-4399-b446-391346c20312', 'volume_name': 'volume-a52ebc59-dd13-4399-b446-391346c20312', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6c0eee-8544-4d52-a1df-9cdea5f8bfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6c0eee-8544-4d52-a1df-9cdea5f8bfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd07c48-d72d-41d9-a0a7-7c825c54bdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:11 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Volume a52ebc59-dd13-4399-b446-391346c20312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a52ebc59-dd13-4399-b446-391346c20312', 'volume_size': 1} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c7efad5d-31e5-4aa0-9096-9c358b3831a8,created_at=2026-09-30T17:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77102200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7efad5d-31e5-4aa0-9096-9c358b3831a8,host='devstack@QuobyteHD#QuobyteHD',id=a52ebc59-dd13-4399-b446-391346c20312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5223407cd04002a5f402b8af7ddfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:11Z,use_quota=True,user_id='9a80223d899f4780951a3311828d6ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8697985-dc8d-43ae-8cf2-292805425c77),volume_type_id=a8697985-dc8d-43ae-8cf2-292805425c77)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Creating volume a52ebc59-dd13-4399-b446-391346c20312 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:39:11 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:39:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:11 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 1073741824 Sep 30 19:39:11 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:12 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 1073741824" returned: 0 in 0.509s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:12 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 Sep 30 19:39:12 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:12 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312" returned: 0 in 0.319s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:39:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd07c48-d72d-41d9-a0a7-7c825c54bdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52ebc59-dd13-4399-b446-391346c20312', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f477ad20-693f-448f-9e5d-e3c8cec588a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:12 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Volume volume-a52ebc59-dd13-4399-b446-391346c20312 (a52ebc59-dd13-4399-b446-391346c20312): created successfully Sep 30 19:39:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f477ad20-693f-448f-9e5d-e3c8cec588a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Flow 'volume_create_manager' (c502eff6-17df-446d-ba5f-63888f09b97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e9994d31-62bf-446a-8f19-4535e6825e74 tempest-GroupSnapshotsV319Test-1124839950 None] Created volume successfully. Sep 30 19:39:13 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] GroupSnapshot 786c7b75-cb6e-4214-a934-9a2640c277b3: creating. Sep 30 19:39:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Group snapshot 786c7b75-cb6e-4214-a934-9a2640c277b3: creating. {{(pid=87426) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 19:39:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Creating offline snapshot 0398c7c0-d795-4b8a-8c86-4a3889b52276 of volume a52ebc59-dd13-4399-b446-391346c20312 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:39:13 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac932a-1e9a-4e4b-9c9c-80e548ef331d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:13 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 Sep 30 19:39:13 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:13 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312" returned: 0 in 0.433s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:13 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 1G Sep 30 19:39:13 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:13 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 1G" returned: 0 in 0.462s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a52ebc59-dd13-4399-b446-391346c20312 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:14 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a52ebc59-dd13-4399-b446-391346c20312 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 Sep 30 19:39:14 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:14 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a52ebc59-dd13-4399-b446-391346c20312 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276" returned: 0 in 0.353s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:14 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:39:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:14 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 Sep 30 19:39:14 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:14 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276" returned: 0 in 0.279s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:14 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.info Sep 30 19:39:14 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:14 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.info" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:14 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:39:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:14 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.info Sep 30 19:39:14 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:15 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.info" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:15 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e2e04828-b5a1-42c7-899a-b76eb3bebb1b tempest-GroupSnapshotsV319Test-1124839950 None] group_snapshot 786c7b75-cb6e-4214-a934-9a2640c277b3: created successfully Sep 30 19:39:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] group_snapshot 786c7b75-cb6e-4214-a934-9a2640c277b3: deleting Sep 30 19:39:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] group_snapshot 786c7b75-cb6e-4214-a934-9a2640c277b3: deleting {{(pid=87426) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 19:39:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Acquiring lock "cinder-quobyte-a52ebc59-dd13-4399-b446-391346c20312" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "cinder-quobyte-a52ebc59-dd13-4399-b446-391346c20312" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Acquiring lock "cinder-quobyte-0398c7c0-d795-4b8a-8c86-4a3889b52276" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "cinder-quobyte-0398c7c0-d795-4b8a-8c86-4a3889b52276" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Deleting offline snapshot 0398c7c0-d795-4b8a-8c86-4a3889b52276 of volume a52ebc59-dd13-4399-b446-391346c20312 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:39:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] snapshot_file for this snap is: volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:39:17 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d20caa-df9d-450b-82d7-d167a708eedc]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:17 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 Sep 30 19:39:17 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:17 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276" returned: 0 in 0.628s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a52ebc59-dd13-4399-b446-391346c20312(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:39:17 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9b50ee-b7c5-4bf0-8c40-e2ecf2023bf5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:17 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 Sep 30 19:39:17 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:18 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312" returned: 0 in 0.434s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:18 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 Sep 30 19:39:18 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:18 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276" returned: 0 in 0.549s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:18 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276 Sep 30 19:39:18 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:19 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312.0398c7c0-d795-4b8a-8c86-4a3889b52276" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "cinder-quobyte-0398c7c0-d795-4b8a-8c86-4a3889b52276" released by "_delete_snapshot" :: held 2.051s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "cinder-quobyte-a52ebc59-dd13-4399-b446-391346c20312" released by "delete_snapshot" :: held 2.104s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:19 devstack cinder-volume[87426]: WARNING cinder.quota [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1237864081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1237864081, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:39:19 devstack cinder-volume[87426]: WARNING cinder.quota [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1237864081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1237864081, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:39:19 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] Created reservations ['2ca8a532-de7b-4962-858c-7dfb8cfd6bf5', 'e1398736-7a82-4921-885b-bee51423f65c', '07e225bc-053c-48cc-b572-0d8b808cb88f', 'd0ad3c06-cbff-4e0f-854d-7c06572923db'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:19 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-9672c521-d75a-489f-b242-1dfdcc6c7e30 tempest-GroupSnapshotsV319Test-1124839950 None] group_snapshot 786c7b75-cb6e-4214-a934-9a2640c277b3: deleted successfully Sep 30 19:39:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Acquiring lock "cinder-quobyte-a52ebc59-dd13-4399-b446-391346c20312" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "cinder-quobyte-a52ebc59-dd13-4399-b446-391346c20312" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:19 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f658418-496a-4391-8a96-915c4a5d23c9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:19 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 Sep 30 19:39:19 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:20 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312" returned: 0 in 0.404s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:20 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312 Sep 30 19:39:20 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:20 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a52ebc59-dd13-4399-b446-391346c20312" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "cinder-quobyte-a52ebc59-dd13-4399-b446-391346c20312" released by "delete_volume" :: held 0.769s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Created reservations ['10506106-1450-4219-b21d-44d47b32592d'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:20 devstack cinder-volume[87426]: WARNING cinder.quota [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1237864081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1237864081, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Created reservations ['a37d8617-4b98-4340-8d53-c857ac86fb93', 'dd180cab-2477-4876-83a2-6a89455cde42', 'f40dfd27-3fb8-43ce-8eae-a6f9aa39fe33', 'c3e7f1b1-2328-4635-81a9-923fff6996f6'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:20 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:39:20 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:20 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.266s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:20 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:39:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5fff54a9-4c82-4367-8eed-ff88d029f292 tempest-GroupSnapshotsV319Test-1124839950 None] Delete group completed successfully. Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Flow 'volume_create_manager' (a24e13c9-2436-448d-b4a5-be3d71511b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de237086-6946-468e-89bf-884eab9d4843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de237086-6946-468e-89bf-884eab9d4843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-723518386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e016887-bbe9-42de-8deb-e9f53bba3d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1842037a342434fba9a315e06bf1064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:22Z,use_quota=True,user_id='402e34f7134d45e180edcc785800441f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250423b2-a65b-44ca-8c39-0b5dbef701ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250423b2-a65b-44ca-8c39-0b5dbef701ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4704f70e-4494-4869-8b8e-0e31b23aa29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4704f70e-4494-4869-8b8e-0e31b23aa29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e016887-bbe9-42de-8deb-e9f53bba3d44', 'volume_name': 'volume-7e016887-bbe9-42de-8deb-e9f53bba3d44', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbba50ff-5823-47d6-89ca-5362128c8e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbba50ff-5823-47d6-89ca-5362128c8e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5f111c-23f5-42a8-81d3-5e8937af37bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:22 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Volume 7e016887-bbe9-42de-8deb-e9f53bba3d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e016887-bbe9-42de-8deb-e9f53bba3d44', 'volume_size': 1} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-723518386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e016887-bbe9-42de-8deb-e9f53bba3d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1842037a342434fba9a315e06bf1064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:22Z,use_quota=True,user_id='402e34f7134d45e180edcc785800441f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Creating volume 7e016887-bbe9-42de-8deb-e9f53bba3d44 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:39:22 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:22 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 1073741824 Sep 30 19:39:22 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:22 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 1073741824" returned: 0 in 0.570s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:22 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 Sep 30 19:39:22 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:23 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5f111c-23f5-42a8-81d3-5e8937af37bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e016887-bbe9-42de-8deb-e9f53bba3d44', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b6bbd3-c0ed-4d44-bee5-40192d379b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:23 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Volume volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 (7e016887-bbe9-42de-8deb-e9f53bba3d44): created successfully Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b6bbd3-c0ed-4d44-bee5-40192d379b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Flow 'volume_create_manager' (a24e13c9-2436-448d-b4a5-be3d71511b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:23 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-309069ca-c708-4dae-b958-396dc18b654e tempest-AttachVolumeTestJSON-932163569 None] Created volume successfully. Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:23 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:39:23 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:24 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.319s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:39:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:39:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 8 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:39:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:39:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4a3fd4c1-a80e-4beb-945c-496f7ccddec7 req-10dbc964-97e8-4f82-a57f-0ca353df50b7 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4a3fd4c1-a80e-4beb-945c-496f7ccddec7 req-10dbc964-97e8-4f82-a57f-0ca353df50b7 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4a3fd4c1-a80e-4beb-945c-496f7ccddec7 req-10dbc964-97e8-4f82-a57f-0ca353df50b7 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-4a3fd4c1-a80e-4beb-945c-496f7ccddec7 req-10dbc964-97e8-4f82-a57f-0ca353df50b7 tempest-AttachVolumeTestJSON-932163569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-7e016887-bbe9-42de-8deb-e9f53bba3d44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1046a49f-a1ec-42b0-9b20-2989ae429fee', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:39:25 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-4a3fd4c1-a80e-4beb-945c-496f7ccddec7 req-10dbc964-97e8-4f82-a57f-0ca353df50b7 tempest-AttachVolumeTestJSON-932163569 None] attachment_update completed successfully. Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Flow 'volume_create_manager' (cdc097c6-7393-4a56-85b4-7f0df84562a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea50228-3f64-4e32-886d-889234220f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea50228-3f64-4e32-886d-889234220f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1671057544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857321d2-525b-415d-9bb7-74d482367e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1842037a342434fba9a315e06bf1064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:28Z,use_quota=True,user_id='402e34f7134d45e180edcc785800441f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd9ee5f-b4f5-410c-84f6-4dd6002ce6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd9ee5f-b4f5-410c-84f6-4dd6002ce6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e378f085-8853-4dee-a552-da752cd997c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e378f085-8853-4dee-a552-da752cd997c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857321d2-525b-415d-9bb7-74d482367e7f', 'volume_name': 'volume-857321d2-525b-415d-9bb7-74d482367e7f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a40946d-d952-49dc-aa3b-aed17b140f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a40946d-d952-49dc-aa3b-aed17b140f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2ed775-026a-4e6e-89d4-e7e089d9f430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Volume 857321d2-525b-415d-9bb7-74d482367e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857321d2-525b-415d-9bb7-74d482367e7f', 'volume_size': 1} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1671057544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857321d2-525b-415d-9bb7-74d482367e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1842037a342434fba9a315e06bf1064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:28Z,use_quota=True,user_id='402e34f7134d45e180edcc785800441f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Creating volume 857321d2-525b-415d-9bb7-74d482367e7f {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:39:27 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:39:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:28 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f 1073741824 Sep 30 19:39:28 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e4ef4af5-5a25-47b1-b169-a238ff299292 tempest-GroupsV314Test-667720082 None] Group tempest-GroupsV314Test-Group-1058606795: creating Sep 30 19:39:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e4ef4af5-5a25-47b1-b169-a238ff299292 tempest-GroupsV314Test-667720082 None] Group tempest-GroupsV314Test-Group-1058606795: created successfully Sep 30 19:39:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e4ef4af5-5a25-47b1-b169-a238ff299292 tempest-GroupsV314Test-667720082 None] Create group completed successfully. Sep 30 19:39:28 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f 1073741824" returned: 0 in 0.650s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:28 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f Sep 30 19:39:28 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:28 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:39:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2ed775-026a-4e6e-89d4-e7e089d9f430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857321d2-525b-415d-9bb7-74d482367e7f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782a7c42-e127-4d2a-bfc2-57e964378da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:28 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Volume volume-857321d2-525b-415d-9bb7-74d482367e7f (857321d2-525b-415d-9bb7-74d482367e7f): created successfully Sep 30 19:39:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782a7c42-e127-4d2a-bfc2-57e964378da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Flow 'volume_create_manager' (cdc097c6-7393-4a56-85b4-7f0df84562a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-129b5cb7-fb2b-4469-80e8-3c6d8bb7aadb tempest-AttachVolumeTestJSON-932163569 None] Created volume successfully. Sep 30 19:39:29 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-253c3f8f-3b43-4070-be56-62ac4a5d043d req-6613ed46-c6ca-49d4-9863-d7f1b26c5a11 tempest-ServerActionsTestOtherA-178048750 None] Terminate volume connection completed successfully. Sep 30 19:39:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-253c3f8f-3b43-4070-be56-62ac4a5d043d req-6613ed46-c6ca-49d4-9863-d7f1b26c5a11 tempest-ServerActionsTestOtherA-178048750 None] Deleting attachment c46dc759-e095-4d7b-98b1-3dc4005a5e2e. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Flow 'volume_create_manager' (c8ec38c0-89ff-4f81-a439-e2f062860ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad63672-c4c9-4a8e-81a9-59902476381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad63672-c4c9-4a8e-81a9-59902476381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-554205738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cde39ab-845f-4b2d-9785-5cefdead2c0b,host='devstack@QuobyteHD#QuobyteHD',id=78728a66-8658-4fb8-b651-a710d77819de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ff0942b59f406097089a8176e9fe73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:30Z,use_quota=True,user_id='686ade125aad47c1ae30786a958e0c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(442cd217-f080-497c-894e-f447308aa989),volume_type_id=442cd217-f080-497c-894e-f447308aa989)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd896fe-c513-41fd-a4d7-00f47fdeaaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd896fe-c513-41fd-a4d7-00f47fdeaaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8b749a-b37c-47e0-8ca5-1c344a9c9676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf8b749a-b37c-47e0-8ca5-1c344a9c9676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78728a66-8658-4fb8-b651-a710d77819de', 'volume_name': 'volume-78728a66-8658-4fb8-b651-a710d77819de', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd37484b-dbec-42d0-b80a-28c982a11558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd37484b-dbec-42d0-b80a-28c982a11558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8343c738-610f-4ea6-8af0-f69133cda3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:30 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Volume 78728a66-8658-4fb8-b651-a710d77819de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78728a66-8658-4fb8-b651-a710d77819de', 'volume_size': 1} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0cde39ab-845f-4b2d-9785-5cefdead2c0b,created_at=2026-09-30T17:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-554205738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cde39ab-845f-4b2d-9785-5cefdead2c0b,host='devstack@QuobyteHD#QuobyteHD',id=78728a66-8658-4fb8-b651-a710d77819de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ff0942b59f406097089a8176e9fe73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:30Z,use_quota=True,user_id='686ade125aad47c1ae30786a958e0c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(442cd217-f080-497c-894e-f447308aa989),volume_type_id=442cd217-f080-497c-894e-f447308aa989)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Creating volume 78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:39:30 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:39:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:30 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de 1073741824 Sep 30 19:39:30 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-56ba338f-0e10-41ee-ba62-5b3148794f16 tempest-GroupsTest-1770225564 None] Group tempest-Group1-88015552: creating Sep 30 19:39:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-56ba338f-0e10-41ee-ba62-5b3148794f16 tempest-GroupsTest-1770225564 None] Group tempest-Group1-88015552: created successfully Sep 30 19:39:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-56ba338f-0e10-41ee-ba62-5b3148794f16 tempest-GroupsTest-1770225564 None] Create group completed successfully. Sep 30 19:39:31 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de 1073741824" returned: 0 in 0.779s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:31 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de Sep 30 19:39:31 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-fb1b2f98-add3-4989-bbfb-29bf5d9dbb71 req-d6355b64-f148-47c0-9ebf-063afe7a44e3 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:31 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de" returned: 0 in 0.366s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-fb1b2f98-add3-4989-bbfb-29bf5d9dbb71 req-d6355b64-f148-47c0-9ebf-063afe7a44e3 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.175s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-fb1b2f98-add3-4989-bbfb-29bf5d9dbb71 req-d6355b64-f148-47c0-9ebf-063afe7a44e3 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8343c738-610f-4ea6-8af0-f69133cda3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78728a66-8658-4fb8-b651-a710d77819de', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25c5346-3ee4-40e3-a8ca-c65791140ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:31 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Volume volume-78728a66-8658-4fb8-b651-a710d77819de (78728a66-8658-4fb8-b651-a710d77819de): created successfully Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25c5346-3ee4-40e3-a8ca-c65791140ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Flow 'volume_create_manager' (c8ec38c0-89ff-4f81-a439-e2f062860ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-71aeea70-b1e0-47c1-96c9-5ea8647dceae tempest-GroupsV314Test-667720082 None] Created volume successfully. Sep 30 19:39:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-fb1b2f98-add3-4989-bbfb-29bf5d9dbb71 req-d6355b64-f148-47c0-9ebf-063afe7a44e3 tempest-AttachVolumeTestJSON-932163569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-857321d2-525b-415d-9bb7-74d482367e7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64b25568-782c-4ffc-bee7-0c4e9592e44a', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:39:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-fb1b2f98-add3-4989-bbfb-29bf5d9dbb71 req-d6355b64-f148-47c0-9ebf-063afe7a44e3 tempest-AttachVolumeTestJSON-932163569 None] attachment_update completed successfully. Sep 30 19:39:32 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2fb8378f-daed-4696-bb92-7e643b50d832 tempest-GroupsTest-1770225564 None] Group tempest-Group2-1665231176: creating Sep 30 19:39:32 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2fb8378f-daed-4696-bb92-7e643b50d832 tempest-GroupsTest-1770225564 None] Group tempest-Group2-1665231176: created successfully Sep 30 19:39:32 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2fb8378f-daed-4696-bb92-7e643b50d832 tempest-GroupsTest-1770225564 None] Create group completed successfully. Sep 30 19:39:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:33 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Cloning volume 78728a66-8658-4fb8-b651-a710d77819de to volume 380f462f-0d4a-443c-8a95-e623224fe02a Sep 30 19:39:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Creating offline snapshot 9536c58b-2a15-4cac-bc3f-ef906e1826d1 of volume 78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:39:33 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ce03d9-63ae-4e56-bbaa-eb4ec23aa72b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:33 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de Sep 30 19:39:33 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:33 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de" returned: 0 in 0.442s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:33 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 1G Sep 30 19:39:33 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Flow 'volume_create_manager' (c1d739e0-f764-4bff-a302-d41c48ce00fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630328b3-4a20-4fc1-9e19-8496b7ab5f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630328b3-4a20-4fc1-9e19-8496b7ab5f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1717460481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57c006dd-25ae-4bcb-8314-5b170e11fea6,host='devstack@QuobyteHD#QuobyteHD',id=4c5b1fc6-3c64-4cf5-88cc-c015906121b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da317d57baa474899b2da1ad02b1639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:34Z,use_quota=True,user_id='687bf1c71c8941ed8cd6028f335cfbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c1dfed0-644a-47ff-9d9b-032ff93bf458),volume_type_id=0c1dfed0-644a-47ff-9d9b-032ff93bf458)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc4cb44-12d4-4b73-8ab5-06e940e62df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc4cb44-12d4-4b73-8ab5-06e940e62df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b08878-be40-4048-a14b-7c628dcde3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b08878-be40-4048-a14b-7c628dcde3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5b1fc6-3c64-4cf5-88cc-c015906121b4', 'volume_name': 'volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af731bf0-3e02-4366-9a17-70bb4459580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af731bf0-3e02-4366-9a17-70bb4459580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff90a4a-edbc-473c-b60c-120e63325ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:34 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Volume 4c5b1fc6-3c64-4cf5-88cc-c015906121b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4', 'volume_size': 1} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:34 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 1G" returned: 0 in 0.537s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78728a66-8658-4fb8-b651-a710d77819de -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:34 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78728a66-8658-4fb8-b651-a710d77819de -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 Sep 30 19:39:34 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:34 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-b37cc78d-e44a-4496-965e-b36802878cf8 req-6fac93ee-beac-4852-94b0-dc0c098a745a tempest-AttachVolumeTestJSON-932163569 None] Terminate volume connection completed successfully. Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-b37cc78d-e44a-4496-965e-b36802878cf8 req-6fac93ee-beac-4852-94b0-dc0c098a745a tempest-AttachVolumeTestJSON-932163569 None] Deleting attachment 1046a49f-a1ec-42b0-9b20-2989ae429fee. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:39:34 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78728a66-8658-4fb8-b651-a710d77819de -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1" returned: 0 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:34 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:39:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:34 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 Sep 30 19:39:34 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:35 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:35 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.info Sep 30 19:39:35 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:35 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.info" returned: 0 in 0.343s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:35 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:35 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.info Sep 30 19:39:35 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:35 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.info" returned: 0 in 0.295s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Acquiring lock "cinder-quobyte-380f462f-0d4a-443c-8a95-e623224fe02a" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Lock "cinder-quobyte-380f462f-0d4a-443c-8a95-e623224fe02a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] snapshot: 9536c58b-2a15-4cac-bc3f-ef906e1826d1, volume: 380f462f-0d4a-443c-8a95-e623224fe02a, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd87fd-d986-4c21-b942-2ae5c87fd24b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:36 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 Sep 30 19:39:36 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:36 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-5b0f00a3-7a85-42d0-a75b-e8b64460892f req-e4c12019-0327-4283-8109-573b65e5bf9d tempest-AttachVolumeTestJSON-932163569 None] Terminate volume connection completed successfully. Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-5b0f00a3-7a85-42d0-a75b-e8b64460892f req-e4c12019-0327-4283-8109-573b65e5bf9d tempest-AttachVolumeTestJSON-932163569 None] Deleting attachment 64b25568-782c-4ffc-bee7-0c4e9592e44a. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:39:36 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1" returned: 0 in 0.435s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78728a66-8658-4fb8-b651-a710d77819de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f59e026-0daa-4f45-ba6d-911568ba239b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:36 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de Sep 30 19:39:36 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:36 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de" returned: 0 in 0.449s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:36 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a Sep 30 19:39:36 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Flow 'volume_create_manager' (7e809c56-d3f4-4d84-a9a9-49c6e45e504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3549b119-e1ec-48ae-a1d4-4f8be8368a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3549b119-e1ec-48ae-a1d4-4f8be8368a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-241543745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d47a3a-151c-440b-9d99-941c163bacdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e587424194d4a61bb01f91a841779f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:37Z,use_quota=True,user_id='9ded284ee0de4838a1c1dda11ac45f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964d9211-8a9c-4a03-a0db-83e5223dcfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964d9211-8a9c-4a03-a0db-83e5223dcfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebf3177-d3e7-4038-be7b-ab4765d5002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:36 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:39:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebf3177-d3e7-4038-be7b-ab4765d5002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60d47a3a-151c-440b-9d99-941c163bacdc', 'volume_name': 'volume-60d47a3a-151c-440b-9d99-941c163bacdc', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9188e84a-242c-4883-8d2d-27e4f4bca9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9188e84a-242c-4883-8d2d-27e4f4bca9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f989bce7-cc65-48a2-87f2-13b8364d4910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:37 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Volume 60d47a3a-151c-440b-9d99-941c163bacdc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60d47a3a-151c-440b-9d99-941c163bacdc', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 19:39:37 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Trying to clone 60d47a3a-151c-440b-9d99-941c163bacdc from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b at location (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:39:38 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:39:38 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Image download 20.69 MB at 20.69 MB/s Sep 30 19:39:38 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[127c3c8d-0e18-4a2a-b5bf-1f1da67d79e1]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:38 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD Sep 30 19:39:38 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:39 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD" returned: 0 in 0.693s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:39 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b is fetched for user 9ded284ee0de4838a1c1dda11ac45f33. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:39:39 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7818e919-c5e2-4318-b7f3-26b4d6d7630d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:39 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD Sep 30 19:39:39 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:40 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD" returned: 0 in 0.826s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "cinder-857321d2-525b-415d-9bb7-74d482367e7f-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-857321d2-525b-415d-9bb7-74d482367e7f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "cinder-quobyte-857321d2-525b-415d-9bb7-74d482367e7f" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-quobyte-857321d2-525b-415d-9bb7-74d482367e7f" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:44 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e651025d-2358-40c3-9f48-537cff6b9ad6]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:44 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f Sep 30 19:39:44 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:44 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f" returned: 0 in 0.649s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:44 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f Sep 30 19:39:44 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:45 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-857321d2-525b-415d-9bb7-74d482367e7f" returned: 0 in 0.369s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-quobyte-857321d2-525b-415d-9bb7-74d482367e7f" released by "delete_volume" :: held 1.121s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Created reservations ['be4c62c4-9561-4727-a231-54258567cc0a', '3dbf16a0-5c94-4a46-b707-8dfb2686e6d1', '4d2d4371-4c1f-4f23-952b-53f9f54cdf31', '3d5fef19-65c4-4217-ad0f-05536f540828'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:45 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a" returned: 0 in 8.543s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de, size 1024.00 MB, duration 8.54 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:39:45 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Converted 1024.00 MB image at 119.85 MB/s Sep 30 19:39:45 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a is being set with open permissions: ugo+rw: NotImplementedError Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:45 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a Sep 30 19:39:45 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:45 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:39:45 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:45 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a" returned: 0 in 0.251s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Lock "cinder-quobyte-380f462f-0d4a-443c-8a95-e623224fe02a" released by "_copy_volume_from_snapshot" :: held 9.769s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Acquiring lock "cinder-quobyte-9536c58b-2a15-4cac-bc3f-ef906e1826d1" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Lock "cinder-quobyte-9536c58b-2a15-4cac-bc3f-ef906e1826d1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Deleting offline snapshot 9536c58b-2a15-4cac-bc3f-ef906e1826d1 of volume 78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] snapshot_file for this snap is: volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[480b64b4-4eed-4a47-85dc-48410441d55d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:45 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.274s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:39:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Deleted volume successfully. Sep 30 19:39:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d49d9225-c90c-4f21-bf3c-4f3c6be19c13 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-857321d2-525b-415d-9bb7-74d482367e7f-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:45 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 Sep 30 19:39:45 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:46 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1" returned: 0 in 0.358s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78728a66-8658-4fb8-b651-a710d77819de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f80689-7041-4119-bada-aabbc1c726f4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:46 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de Sep 30 19:39:46 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "cinder-7e016887-bbe9-42de-8deb-e9f53bba3d44-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-7e016887-bbe9-42de-8deb-e9f53bba3d44-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "cinder-quobyte-7e016887-bbe9-42de-8deb-e9f53bba3d44" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-quobyte-7e016887-bbe9-42de-8deb-e9f53bba3d44" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d64e8f-d885-4fd6-a722-eb6b9e6cebf9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:46 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 Sep 30 19:39:46 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:46 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de" returned: 0 in 0.561s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:46 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 Sep 30 19:39:46 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:46 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44" returned: 0 in 0.398s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:46 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44 Sep 30 19:39:46 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:47 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1" returned: 0 in 0.358s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:47 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1 Sep 30 19:39:47 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:47 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7e016887-bbe9-42de-8deb-e9f53bba3d44" returned: 0 in 0.250s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-quobyte-7e016887-bbe9-42de-8deb-e9f53bba3d44" released by "delete_volume" :: held 0.693s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Created reservations ['aca67740-4e7b-4ee3-90ff-3f7ce60312ec', '05fc9056-3fd5-477d-9699-feca71df1eb1', '31299f6e-0d93-46b3-93a8-d846e5a8b2ff', 'fbddd809-fc49-4553-95b3-cdc394c108dc'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:47 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de.9536c58b-2a15-4cac-bc3f-ef906e1826d1" returned: 0 in 0.282s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:47 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:39:47 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Lock "cinder-quobyte-9536c58b-2a15-4cac-bc3f-ef906e1826d1" released by "_delete_snapshot" :: held 1.673s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.913s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57c006dd-25ae-4bcb-8314-5b170e11fea6,created_at=2026-09-30T17:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1717460481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57c006dd-25ae-4bcb-8314-5b170e11fea6,host='devstack@QuobyteHD#QuobyteHD',id=4c5b1fc6-3c64-4cf5-88cc-c015906121b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da317d57baa474899b2da1ad02b1639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:34Z,use_quota=True,user_id='687bf1c71c8941ed8cd6028f335cfbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c1dfed0-644a-47ff-9d9b-032ff93bf458),volume_type_id=0c1dfed0-644a-47ff-9d9b-032ff93bf458)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Creating volume 4c5b1fc6-3c64-4cf5-88cc-c015906121b4 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:39:47 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:47 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 1073741824 Sep 30 19:39:47 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:47 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-33e73f6f-1f68-473e-ab61-5a32c258ec5e tempest-GroupsV314Test-667720082 None] Create group from source-group-0cde39ab-845f-4b2d-9785-5cefdead2c0b completed successfully. Sep 30 19:39:47 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.268s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:39:47 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Deleted volume successfully. Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7cb0066c-53d3-4598-a98c-e11bb5774d64 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-7e016887-bbe9-42de-8deb-e9f53bba3d44-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "cinder-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "cinder-quobyte-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-quobyte-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2691dd8-6eaa-41f1-bc48-b473edbc4d93]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:47 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 1073741824" returned: 0 in 0.563s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:47 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f Sep 30 19:39:47 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:48 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 Sep 30 19:39:48 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Acquiring lock "cinder-quobyte-380f462f-0d4a-443c-8a95-e623224fe02a" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Lock "cinder-quobyte-380f462f-0d4a-443c-8a95-e623224fe02a" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:48 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f" returned: 0 in 0.449s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[82444fcc-56fe-4107-87fc-d93c1b27eefd]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:48 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f Sep 30 19:39:48 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:48 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4" returned: 0 in 0.331s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.938s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-241543745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d47a3a-151c-440b-9d99-941c163bacdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e587424194d4a61bb01f91a841779f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:37Z,use_quota=True,user_id='9ded284ee0de4838a1c1dda11ac45f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Creating volume 60d47a3a-151c-440b-9d99-941c163bacdc {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:39:48 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff90a4a-edbc-473c-b60c-120e63325ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efa4901-366b-4aff-bb07-03e9d5e5aee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:48 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc 1073741824 Sep 30 19:39:48 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:48 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Volume volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 (4c5b1fc6-3c64-4cf5-88cc-c015906121b4): created successfully Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efa4901-366b-4aff-bb07-03e9d5e5aee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Flow 'volume_create_manager' (c1d739e0-f764-4bff-a302-d41c48ce00fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1d5ed99a-f0d7-4939-9e04-bb188d13e0be tempest-GroupsTest-1770225564 None] Created volume successfully. Sep 30 19:39:48 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a Sep 30 19:39:48 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:48 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f" returned: 0 in 0.278s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-quobyte-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f" released by "delete_volume" :: held 0.784s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Created reservations ['aa29372b-5492-4beb-b8ef-3cf7f4f95f95', '5e412483-6a39-41c0-98d6-2cb9c90c6d63', 'd4a9cd10-24c2-4b00-bcee-5265ad1600af', 'fda49fe2-6292-4931-88e9-024ed506e8c1'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:48 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:39:48 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:48 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a" returned: 0 in 0.444s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:48 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a Sep 30 19:39:48 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:48 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc 1073741824" returned: 0 in 0.531s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:48 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc Sep 30 19:39:48 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:49 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.318s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:39:49 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Deleted volume successfully. Sep 30 19:39:49 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-380f462f-0d4a-443c-8a95-e623224fe02a" returned: 0 in 0.317s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74df6a4b-775d-4099-a578-ef089c5712b8 tempest-AttachVolumeTestJSON-932163569 None] Lock "cinder-8c3b96c5-a011-45dc-a1f7-1d3664af2e4f-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Lock "cinder-quobyte-380f462f-0d4a-443c-8a95-e623224fe02a" released by "delete_volume" :: held 0.838s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Created reservations ['73860ca1-2fd2-4483-81fb-ca45f79c9281'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:49 devstack cinder-volume[87426]: WARNING cinder.quota [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-311427380 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-311427380, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:39:49 devstack cinder-volume[87426]: WARNING cinder.quota [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-311427380 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-311427380, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Created reservations ['32336c8d-31cf-4c9a-a04b-0b8cfb295dbb', '2675bb23-dd27-4e90-9fb3-9210ceecafd8', '5ebe40b1-a52f-4a1b-aaca-852470830d45', '2dfad461-f2db-4e85-a065-c21b9e765af1'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:49 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc" returned: 0 in 0.304s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Attempting download of 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume 60d47a3a-151c-440b-9d99-941c163bacdc. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[155189f8-2283-46ff-b98f-75dd6b4d193b]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_2ve55jb_ {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:49 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_2ve55jb_ Sep 30 19:39:49 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:49 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:39:49 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:49 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_2ve55jb_" returned: 0 in 0.389s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_2ve55jb_ {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:49 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.383s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:39:49 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f164beeb-9eea-4014-a335-b2bc36777bfc tempest-GroupsV314Test-667720082 None] Delete group completed successfully. Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Acquiring lock "cinder-quobyte-78728a66-8658-4fb8-b651-a710d77819de" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Lock "cinder-quobyte-78728a66-8658-4fb8-b651-a710d77819de" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:49 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_2ve55jb_ Sep 30 19:39:49 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01706cb-6bba-4ae2-9800-92e0fe2c4564]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:50 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de Sep 30 19:39:50 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Acquiring lock "cinder-quobyte-4c5b1fc6-3c64-4cf5-88cc-c015906121b4" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Lock "cinder-quobyte-4c5b1fc6-3c64-4cf5-88cc-c015906121b4" acquired by "delete_volume" :: waited 0.029s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:39:50 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_2ve55jb_" returned: 1 in 0.522s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_2ve55jb_' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba3260c-036c-43ad-8902-bf1a6ad15ccc]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c5ff43-5a41-4c40-a19c-1991ba94312c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:50 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD Sep 30 19:39:50 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:50 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de" returned: 0 in 0.527s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:50 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 Sep 30 19:39:50 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:50 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de Sep 30 19:39:50 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:50 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] 5be8283e-b86b-4bc8-8baa-e16813f20b2b was qcow2, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:50 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:50 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc Sep 30 19:39:50 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-78728a66-8658-4fb8-b651-a710d77819de" returned: 0 in 0.264s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Lock "cinder-quobyte-78728a66-8658-4fb8-b651-a710d77819de" released by "delete_volume" :: held 0.891s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:50 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4" returned: 0 in 0.496s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:50 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4 Sep 30 19:39:50 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Created reservations ['669003b3-cf82-4523-8546-e292c0431a09'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:50 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Created reservations ['9ba58aa8-5995-47d5-8791-e7ab30734c1c', 'a0da53a2-ff1d-4f68-a6b7-5b13ecaa5737', 'eb23c807-1e61-47d4-8866-0abf3f4184c9', '66106fad-2094-49a3-af85-958c7ef32a28'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:51 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:39:51 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:51 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4c5b1fc6-3c64-4cf5-88cc-c015906121b4" returned: 0 in 0.389s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Lock "cinder-quobyte-4c5b1fc6-3c64-4cf5-88cc-c015906121b4" released by "delete_volume" :: held 0.975s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Created reservations ['46902d8b-777c-4a17-be66-c81b1b979d31'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:51 devstack cinder-volume[87426]: WARNING cinder.quota [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-891545885 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-891545885, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:39:51 devstack cinder-volume[87426]: WARNING cinder.quota [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-891545885 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-891545885, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Created reservations ['0cfe5bc7-8345-46de-9b7b-add88a5d885a', '9cdb8bd8-9cb9-4724-8fa2-cd724c7a64ee', 'b2e8e74f-d3ee-4aee-a927-1b1c4fd78077', '5b5fac33-e276-4e49-b5d6-839a4f80bef7'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:51 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.405s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:39:51 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-86210c7d-7bed-43bb-9f9d-15eab5179b95 tempest-GroupsV314Test-667720082 None] Delete group completed successfully. Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:51 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:39:51 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:51 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.373s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] Created reservations ['72565870-d30f-47cc-b900-be86eb177336'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:39:51 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-13c6ae6e-5098-4680-b9c6-ad59d5a3cbf6 tempest-GroupsTest-1770225564 None] Delete group completed successfully. Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:52 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:39:52 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:52 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.327s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:52 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:39:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-526dbd42-72ee-41a6-b964-188efd49afc6 tempest-GroupsTest-1770225564 None] Delete group completed successfully. Sep 30 19:39:53 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc" returned: 0 in 2.714s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_mqwpem35devstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:39:53 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Converted 112.00 MB image at 41.24 MB/s Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:53 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc 1G Sep 30 19:39:53 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-12f2b7b5-5d30-428f-b406-027d871345d0 tempest-GroupsTest-1770225564 None] Group tempest-GroupsTest-Group-197872577: creating Sep 30 19:39:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-12f2b7b5-5d30-428f-b406-027d871345d0 tempest-GroupsTest-1770225564 None] Group tempest-GroupsTest-Group-197872577: created successfully Sep 30 19:39:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-12f2b7b5-5d30-428f-b406-027d871345d0 tempest-GroupsTest-1770225564 None] Create group completed successfully. Sep 30 19:39:53 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc 1G" returned: 0 in 0.478s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Downloaded image 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume 60d47a3a-151c-440b-9d99-941c163bacdc successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b for user 9ded284ee0de4838a1c1dda11ac45f33 is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Marking volume 60d47a3a-151c-440b-9d99-941c163bacdc as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Copying metadata from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b to 60d47a3a-151c-440b-9d99-941c163bacdc. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Creating volume glance metadata for volume 60d47a3a-151c-440b-9d99-941c163bacdc backed by image 5be8283e-b86b-4bc8-8baa-e16813f20b2b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f989bce7-cc65-48a2-87f2-13b8364d4910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d47a3a-151c-440b-9d99-941c163bacdc', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c8ae0e-bd70-48ec-8ef7-5b6a6eab4dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:54 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Volume volume-60d47a3a-151c-440b-9d99-941c163bacdc (60d47a3a-151c-440b-9d99-941c163bacdc): created successfully Sep 30 19:39:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c8ae0e-bd70-48ec-8ef7-5b6a6eab4dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Flow 'volume_create_manager' (7e809c56-d3f4-4d84-a9a9-49c6e45e504c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:54 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7dd9b9d9-07b2-4c98-885e-89209ff7425d tempest-ServerActionsTestOtherA-178048750 None] Created volume successfully. Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Flow 'volume_create_manager' (c21c2579-4c3b-4240-9ebb-244f06cc1ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539cf916-f063-470b-8dc0-4ad03d84e68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539cf916-f063-470b-8dc0-4ad03d84e68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248032882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e39e117-1993-41f3-a47c-614d84471b80,host='devstack@QuobyteHD#QuobyteHD',id=2ddec5a3-b710-45a2-a3b1-a5bbfb547424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da317d57baa474899b2da1ad02b1639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:55Z,use_quota=True,user_id='687bf1c71c8941ed8cd6028f335cfbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6e21a23-c05c-4e11-9d0e-25a01965d2c1),volume_type_id=a6e21a23-c05c-4e11-9d0e-25a01965d2c1)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3bf6ae-ee9b-4b10-a44f-79e536859c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3bf6ae-ee9b-4b10-a44f-79e536859c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0f3a2e-785c-4a53-b8f1-db35354419d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0f3a2e-785c-4a53-b8f1-db35354419d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ddec5a3-b710-45a2-a3b1-a5bbfb547424', 'volume_name': 'volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d187bab-3187-4148-b673-9c5396509484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d187bab-3187-4148-b673-9c5396509484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6b84ab-85a6-4700-8f6d-b86b70447781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:55 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Volume 2ddec5a3-b710-45a2-a3b1-a5bbfb547424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424', 'volume_size': 1} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e39e117-1993-41f3-a47c-614d84471b80,created_at=2026-09-30T17:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248032882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e39e117-1993-41f3-a47c-614d84471b80,host='devstack@QuobyteHD#QuobyteHD',id=2ddec5a3-b710-45a2-a3b1-a5bbfb547424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da317d57baa474899b2da1ad02b1639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:55Z,use_quota=True,user_id='687bf1c71c8941ed8cd6028f335cfbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6e21a23-c05c-4e11-9d0e-25a01965d2c1),volume_type_id=a6e21a23-c05c-4e11-9d0e-25a01965d2c1)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Creating volume 2ddec5a3-b710-45a2-a3b1-a5bbfb547424 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:39:55 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:39:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:55 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 1073741824 Sep 30 19:39:55 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:56 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 1073741824" returned: 0 in 0.581s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:56 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 Sep 30 19:39:56 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:56 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:39:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6b84ab-85a6-4700-8f6d-b86b70447781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb530a62-e20d-446b-b7b2-b4ea89a8355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Volume volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 (2ddec5a3-b710-45a2-a3b1-a5bbfb547424): created successfully Sep 30 19:39:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb530a62-e20d-446b-b7b2-b4ea89a8355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Flow 'volume_create_manager' (c21c2579-4c3b-4240-9ebb-244f06cc1ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a7541eaa-4b64-459b-82b9-3cb8cd7596db tempest-GroupsTest-1770225564 None] Created volume successfully. Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Flow 'volume_create_manager' (1e80dc1e-c383-40a9-9b2b-ef32a9616f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2450b7-e962-4539-a1bf-b54f431952cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2450b7-e962-4539-a1bf-b54f431952cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-456134850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e39e117-1993-41f3-a47c-614d84471b80,host='devstack@QuobyteHD#QuobyteHD',id=5d6a06a8-7db4-40d7-ae4d-b03bb0095bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da317d57baa474899b2da1ad02b1639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:57Z,use_quota=True,user_id='687bf1c71c8941ed8cd6028f335cfbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6e21a23-c05c-4e11-9d0e-25a01965d2c1),volume_type_id=a6e21a23-c05c-4e11-9d0e-25a01965d2c1)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cef9b7-4c73-476b-9ca5-72ad42e36fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cef9b7-4c73-476b-9ca5-72ad42e36fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85faae87-3551-4aff-a887-ed5ecdbf0688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85faae87-3551-4aff-a887-ed5ecdbf0688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d6a06a8-7db4-40d7-ae4d-b03bb0095bba', 'volume_name': 'volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a31526-149c-4b1c-8330-777bb4cd1beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a31526-149c-4b1c-8330-777bb4cd1beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2298c21-7f54-40cc-abe1-3bba47421fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Volume 5d6a06a8-7db4-40d7-ae4d-b03bb0095bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba', 'volume_size': 1} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e39e117-1993-41f3-a47c-614d84471b80,created_at=2026-09-30T17:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-456134850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e39e117-1993-41f3-a47c-614d84471b80,host='devstack@QuobyteHD#QuobyteHD',id=5d6a06a8-7db4-40d7-ae4d-b03bb0095bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da317d57baa474899b2da1ad02b1639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:57Z,use_quota=True,user_id='687bf1c71c8941ed8cd6028f335cfbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6e21a23-c05c-4e11-9d0e-25a01965d2c1),volume_type_id=a6e21a23-c05c-4e11-9d0e-25a01965d2c1)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Creating volume 5d6a06a8-7db4-40d7-ae4d-b03bb0095bba {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:39:57 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:39:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:57 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba 1073741824 Sep 30 19:39:57 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:58 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba 1073741824" returned: 0 in 0.653s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:58 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba Sep 30 19:39:58 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:39:58 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba" returned: 0 in 0.424s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2298c21-7f54-40cc-abe1-3bba47421fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21212789-b0e2-4b8d-9ca1-b2c6aca406bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:58 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Volume volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba (5d6a06a8-7db4-40d7-ae4d-b03bb0095bba): created successfully Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21212789-b0e2-4b8d-9ca1-b2c6aca406bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Flow 'volume_create_manager' (1e80dc1e-c383-40a9-9b2b-ef32a9616f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7abd87c7-f249-41b7-8a17-353bf1a7f607 tempest-GroupsTest-1770225564 None] Created volume successfully. Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4d18fee9-832d-4d96-9047-b475f909110c req-b81193b8-eb29-45d9-a968-e07959ecd6e5 tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4d18fee9-832d-4d96-9047-b475f909110c req-b81193b8-eb29-45d9-a968-e07959ecd6e5 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4d18fee9-832d-4d96-9047-b475f909110c req-b81193b8-eb29-45d9-a968-e07959ecd6e5 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-4d18fee9-832d-4d96-9047-b475f909110c req-b81193b8-eb29-45d9-a968-e07959ecd6e5 tempest-ServerActionsTestOtherA-178048750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-60d47a3a-151c-440b-9d99-941c163bacdc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43b782b2-01da-4aee-bd5c-827bfa1a371c', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:39:59 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-4d18fee9-832d-4d96-9047-b475f909110c req-b81193b8-eb29-45d9-a968-e07959ecd6e5 tempest-ServerActionsTestOtherA-178048750 None] attachment_update completed successfully. Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Flow 'volume_create_manager' (6c39de65-5df8-4fd1-bf59-0ce4751bbfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f44d6f-4c75-47b2-a118-3b0130aa939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f44d6f-4c75-47b2-a118-3b0130aa939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-522168119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4f1e31-b31d-4d15-98ce-3ac27774e3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc72da413bf497e8e208c0975292785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:59Z,use_quota=True,user_id='68e3b94dd81245e28ce422c1fb81d0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2a1ff7-58c2-4e19-af88-91f07be08418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2a1ff7-58c2-4e19-af88-91f07be08418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b72fe7-b3b8-4b13-9d73-73fa91b25828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b72fe7-b3b8-4b13-9d73-73fa91b25828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4f1e31-b31d-4d15-98ce-3ac27774e3ae', 'volume_name': 'volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11009db9-03ca-43da-a750-b1d31328c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11009db9-03ca-43da-a750-b1d31328c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc79e50-f079-4d7a-870f-4195c9f5ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:39:59 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Volume 4e4f1e31-b31d-4d15-98ce-3ac27774e3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae', 'volume_size': 1} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-522168119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4f1e31-b31d-4d15-98ce-3ac27774e3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc72da413bf497e8e208c0975292785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:39:59Z,use_quota=True,user_id='68e3b94dd81245e28ce422c1fb81d0c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Creating volume 4e4f1e31-b31d-4d15-98ce-3ac27774e3ae {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:39:59 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:39:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:39:59 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae 1073741824 Sep 30 19:39:59 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:00 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae 1073741824" returned: 0 in 0.573s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:00 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae Sep 30 19:40:00 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e18ef80d-b09b-4402-9804-f720816915eb tempest-GroupsTest-1770225564 None] Update group completed successfully. Sep 30 19:40:00 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" returned: 0 in 0.357s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:40:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc79e50-f079-4d7a-870f-4195c9f5ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f524e53d-6507-465b-b9d6-262333709243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:00 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Volume volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae (4e4f1e31-b31d-4d15-98ce-3ac27774e3ae): created successfully Sep 30 19:40:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f524e53d-6507-465b-b9d6-262333709243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Flow 'volume_create_manager' (6c39de65-5df8-4fd1-bf59-0ce4751bbfae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-c785da0a-a4cf-4826-b243-275f85b5a660 req-5d371961-6408-4df8-8cda-60b942b77b15 tempest-VolumesSnapshotsTestJSON-927688116 None] Created volume successfully. Sep 30 19:40:01 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8b5551d3-a040-4016-bbee-b9027a22a7d2 tempest-GroupsTest-1770225564 None] Update group completed successfully. Sep 30 19:40:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Creating offline snapshot c2deca2c-0526-4654-8e27-85da1e41b5cb of volume 4e4f1e31-b31d-4d15-98ce-3ac27774e3ae {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:40:02 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad4c39d-32f2-41ca-bb9b-c8769014e8c8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:02 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae Sep 30 19:40:02 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:02 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" returned: 0 in 0.765s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:02 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb 1G Sep 30 19:40:02 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:03 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb 1G" returned: 0 in 0.662s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:03 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb Sep 30 19:40:03 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Acquiring lock "cinder-quobyte-2ddec5a3-b710-45a2-a3b1-a5bbfb547424" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Lock "cinder-quobyte-2ddec5a3-b710-45a2-a3b1-a5bbfb547424" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0f0dee-f0ea-482c-9861-ae3eb80c36bd]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:04 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb" returned: 0 in 0.493s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:04 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb is being set with open permissions: ugo+rw Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:04 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb Sep 30 19:40:04 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:04 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 Sep 30 19:40:04 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:04 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb" returned: 0 in 0.296s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:04 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.info Sep 30 19:40:04 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:04 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424" returned: 0 in 0.452s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:04 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424 Sep 30 19:40:04 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:04 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.info" returned: 0 in 0.313s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:04 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.info is being set with open permissions: ugo+rw Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:04 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.info Sep 30 19:40:04 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:04 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2ddec5a3-b710-45a2-a3b1-a5bbfb547424" returned: 0 in 0.485s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Lock "cinder-quobyte-2ddec5a3-b710-45a2-a3b1-a5bbfb547424" released by "delete_volume" :: held 1.008s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Acquiring lock "cinder-quobyte-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Lock "cinder-quobyte-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca282f-4a07-41b4-bd0d-badbcccd15ae]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:05 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.info" returned: 0 in 0.380s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:05 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-5f4c23cd-67c1-48ff-a782-c2220858eb12 req-332ce211-773a-450f-a915-637be93c3692 tempest-VolumesSnapshotsTestJSON-927688116 None] Create snapshot completed successfully Sep 30 19:40:05 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba Sep 30 19:40:05 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:05 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba" returned: 0 in 0.478s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:05 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba Sep 30 19:40:05 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:05 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba" returned: 0 in 0.323s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Lock "cinder-quobyte-5d6a06a8-7db4-40d7-ae4d-b03bb0095bba" released by "delete_volume" :: held 0.880s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Created reservations ['8bf08afc-4c6c-4eab-9ee0-330be4fc1d5a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:06 devstack cinder-volume[87426]: WARNING cinder.quota [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-763086691 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-763086691, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:40:06 devstack cinder-volume[87426]: WARNING cinder.quota [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-763086691 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-763086691, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Created reservations ['6ef7c496-6a1c-47d5-84b8-ffe700b33935', 'c512fada-d30c-42d1-90bc-7ef8eb4e5ec4', '8336de3f-324f-46df-a331-e120f61f9cd1', '4857fef4-90ee-47ac-b0f0-9fa1d8e8de78'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Acquiring lock "cinder-c2deca2c-0526-4654-8e27-85da1e41b5cb-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-c2deca2c-0526-4654-8e27-85da1e41b5cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Acquiring lock "cinder-quobyte-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-quobyte-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" acquired by "delete_snapshot" :: waited 0.085s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Acquiring lock "cinder-quobyte-c2deca2c-0526-4654-8e27-85da1e41b5cb" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Created reservations ['c32b73a6-8295-489f-9882-952de63f8883', '47379fbf-8353-416a-b77d-003fc3f52adf', 'd844a675-2983-4c47-b1e5-e3ee984b82b0', '0364e8fa-b86c-491c-80b3-3500b699c436'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-quobyte-c2deca2c-0526-4654-8e27-85da1e41b5cb" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Deleting offline snapshot c2deca2c-0526-4654-8e27-85da1e41b5cb of volume 4e4f1e31-b31d-4d15-98ce-3ac27774e3ae {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] snapshot_file for this snap is: volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06ad9e2-70b9-4382-8b22-2b8c92dadb94]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:07 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb Sep 30 19:40:07 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:07 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:40:07 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:07 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb" returned: 0 in 0.771s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:40:07 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.585s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:07 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:40:07 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7ba450-5254-4201-a915-649de31b8b82]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-84645ff3-9073-4326-b4e5-73c5ffefb3f6 tempest-GroupsTest-1770225564 None] Delete group completed successfully. Sep 30 19:40:07 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae Sep 30 19:40:07 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:08 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" returned: 0 in 0.588s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:08 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb Sep 30 19:40:08 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:08 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb" returned: 0 in 0.738s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:08 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb Sep 30 19:40:08 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:09 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae.c2deca2c-0526-4654-8e27-85da1e41b5cb" returned: 0 in 0.487s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:09 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=134,cinder:UPDATE=160,cinder:DELETE=8,cinder:INSERT=45 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:40:09 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=131,cinder:SELECT=175,cinder:INSERT=27,cinder:DELETE=5 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:40:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-quobyte-c2deca2c-0526-4654-8e27-85da1e41b5cb" released by "_delete_snapshot" :: held 2.845s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-quobyte-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" released by "delete_snapshot" :: held 2.918s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:09 devstack cinder-volume[87426]: WARNING cinder.quota [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:40:09 devstack cinder-volume[87426]: DEBUG cinder.quota [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Created reservations ['1a83a629-8d31-48d3-9226-ba00c4a92052', 'c5f55673-e621-43cc-a27b-66763ca7f159', '6e676d11-0493-4d3a-9529-f20dc7d87362', '8ddfdcdc-80e5-4cd7-bec7-08f0c4a51235'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Delete snapshot completed successfully. Sep 30 19:40:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-a293b25a-dea8-4348-b70c-197e613870e4 req-e00e44cd-6446-4be5-96ba-09b33a49a800 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-c2deca2c-0526-4654-8e27-85da1e41b5cb-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Acquiring lock "cinder-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Acquiring lock "cinder-quobyte-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-quobyte-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:10 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eac4dff-65ee-405a-9254-1cc947130dc2]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:10 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae Sep 30 19:40:10 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:11 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" returned: 0 in 0.671s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:11 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae Sep 30 19:40:11 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:11 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" returned: 0 in 0.725s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-quobyte-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae" released by "delete_volume" :: held 1.561s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG cinder.quota [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Created reservations ['486a6508-7bbc-4e01-a755-eb2e0aeaaf7f', 'd51c1535-cb85-443b-afd2-24eed3ba4567', '53cfa945-ec34-442a-b811-08ff1fe0f2be', 'c1abf025-c857-48c3-924e-464c6a91f604'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:12 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:40:12 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:12 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.531s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:12 devstack cinder-volume[87426]: DEBUG cinder.manager [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:40:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Deleted volume successfully. Sep 30 19:40:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-b67bd82d-7956-48a3-ab38-95005e5587bf req-b6ddf070-f204-448a-b701-c45627e092f7 tempest-VolumesSnapshotsTestJSON-927688116 None] Lock "cinder-4e4f1e31-b31d-4d15-98ce-3ac27774e3ae-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:19 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-4fab8cda-f37e-4201-9ead-67e51e0ce635 req-2a9203de-5e49-4b58-b9bb-e41438d1402a tempest-ServerActionsTestOtherA-178048750 None] Terminate volume connection completed successfully. Sep 30 19:40:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-4fab8cda-f37e-4201-9ead-67e51e0ce635 req-2a9203de-5e49-4b58-b9bb-e41438d1402a tempest-ServerActionsTestOtherA-178048750 None] Deleting attachment 43b782b2-01da-4aee-bd5c-827bfa1a371c. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4fab8cda-f37e-4201-9ead-67e51e0ce635 req-982194e8-715b-4fd6-820a-53cf685557e1 tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4fab8cda-f37e-4201-9ead-67e51e0ce635 req-982194e8-715b-4fd6-820a-53cf685557e1 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4fab8cda-f37e-4201-9ead-67e51e0ce635 req-982194e8-715b-4fd6-820a-53cf685557e1 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-4fab8cda-f37e-4201-9ead-67e51e0ce635 req-982194e8-715b-4fd6-820a-53cf685557e1 tempest-ServerActionsTestOtherA-178048750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-60d47a3a-151c-440b-9d99-941c163bacdc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00f0626a-69ba-445a-a572-c6d450248998', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Flow 'volume_create_manager' (94076277-bc1c-40bf-80cf-c187a18e5445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8e112a-58d8-45ad-b90e-70c35d0740a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-4fab8cda-f37e-4201-9ead-67e51e0ce635 req-982194e8-715b-4fd6-820a-53cf685557e1 tempest-ServerActionsTestOtherA-178048750 None] attachment_update completed successfully. Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8e112a-58d8-45ad-b90e-70c35d0740a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1834596377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53c9acd-b2f6-4911-abf7-9be4f221b7f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7249549094321bf74bdeda991bed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:21Z,use_quota=True,user_id='e2ff9475ac08424caa26d91473f168d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872408ed-478a-482c-a962-e88dca8a7ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872408ed-478a-482c-a962-e88dca8a7ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc8073b-b186-40d4-90eb-cafc8fb80a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc8073b-b186-40d4-90eb-cafc8fb80a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd53c9acd-b2f6-4911-abf7-9be4f221b7f3', 'volume_name': 'volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269954b0-b75c-4d44-a449-2282530bbdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269954b0-b75c-4d44-a449-2282530bbdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e38e02-db89-4dc8-b55d-d585d59425ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Volume d53c9acd-b2f6-4911-abf7-9be4f221b7f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3', 'volume_size': 1} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1834596377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53c9acd-b2f6-4911-abf7-9be4f221b7f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7249549094321bf74bdeda991bed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:21Z,use_quota=True,user_id='e2ff9475ac08424caa26d91473f168d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Creating volume d53c9acd-b2f6-4911-abf7-9be4f221b7f3 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:40:21 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:40:21 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 1073741824 Sep 30 19:40:21 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Flow 'volume_create_manager' (eb292d86-7883-4aa2-a026-a385316104b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebe381c-b6aa-40ba-8a43-fcb27b1488b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebe381c-b6aa-40ba-8a43-fcb27b1488b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-591138808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed173845904445b40c0688b8c36776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:21Z,use_quota=True,user_id='4ef6e414d46246948d1bf1317c62af32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a159d89-d482-4900-a578-0edb9ccfba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a159d89-d482-4900-a578-0edb9ccfba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07142a02-35bb-49cd-ac51-bb7e5c90215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07142a02-35bb-49cd-ac51-bb7e5c90215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524', 'volume_name': 'volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621b8bb3-eeb9-437b-9efa-2c42e7d8e892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621b8bb3-eeb9-437b-9efa-2c42e7d8e892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a700f2-54dd-45b8-a436-52eb71466b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:21 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Volume 6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524', 'volume_size': 1} Sep 30 19:40:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:22 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 1073741824" returned: 0 in 0.577s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:22 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 Sep 30 19:40:22 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:22 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3" returned: 0 in 0.509s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-591138808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aed173845904445b40c0688b8c36776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:21Z,use_quota=True,user_id='4ef6e414d46246948d1bf1317c62af32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Creating volume 6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:40:22 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e38e02-db89-4dc8-b55d-d585d59425ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248abdf4-dcde-421e-8d6f-9a0d4711d835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:22 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 1073741824 Sep 30 19:40:22 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:22 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Volume volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 (d53c9acd-b2f6-4911-abf7-9be4f221b7f3): created successfully Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248abdf4-dcde-421e-8d6f-9a0d4711d835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Flow 'volume_create_manager' (94076277-bc1c-40bf-80cf-c187a18e5445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:22 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c8790244-df43-4c0c-9cbc-ecd574e2b0d2 tempest-VolumesTestJSON-2035998515 None] Created volume successfully. Sep 30 19:40:23 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 1073741824" returned: 0 in 0.822s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:23 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 Sep 30 19:40:23 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:23 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524" returned: 0 in 0.364s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:40:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:24 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:40:24 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a700f2-54dd-45b8-a436-52eb71466b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbbc120-7b23-4021-b064-ecbf678f12d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:24 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Volume volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 (6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524): created successfully Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbbc120-7b23-4021-b064-ecbf678f12d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Flow 'volume_create_manager' (eb292d86-7883-4aa2-a026-a385316104b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:24 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f99a3f8f-1d5a-4dac-92e0-7fd75e0d828b tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Created volume successfully. Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Flow 'volume_create_manager' (367633a6-1818-4ceb-854e-07deff6889a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f3031a-6fe6-4c3e-9fd5-4521bdd67243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:24 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.494s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f3031a-6fe6-4c3e-9fd5-4521bdd67243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-795360197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0902028c-d58d-414f-97f2-cddea3ceac4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7249549094321bf74bdeda991bed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:24Z,use_quota=True,user_id='e2ff9475ac08424caa26d91473f168d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed655c21-cd9f-492e-a210-72f413b483d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed655c21-cd9f-492e-a210-72f413b483d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807f2862-b353-422c-baf4-d166ebad05f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807f2862-b353-422c-baf4-d166ebad05f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0902028c-d58d-414f-97f2-cddea3ceac4c', 'volume_name': 'volume-0902028c-d58d-414f-97f2-cddea3ceac4c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bab27c5-19e5-4bff-944a-5e912b5b2330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bab27c5-19e5-4bff-944a-5e912b5b2330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5ed656-6fcd-46c1-88bd-95fee37d54a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:24 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Volume 0902028c-d58d-414f-97f2-cddea3ceac4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0902028c-d58d-414f-97f2-cddea3ceac4c', 'volume_size': 1} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-795360197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0902028c-d58d-414f-97f2-cddea3ceac4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7249549094321bf74bdeda991bed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:24Z,use_quota=True,user_id='e2ff9475ac08424caa26d91473f168d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Creating volume 0902028c-d58d-414f-97f2-cddea3ceac4c {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:40:24 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:40:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:40:24 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c 1073741824 Sep 30 19:40:24 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:25 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c 1073741824" returned: 0 in 0.643s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:25 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c Sep 30 19:40:25 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:25 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c" returned: 0 in 0.426s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:40:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5ed656-6fcd-46c1-88bd-95fee37d54a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0902028c-d58d-414f-97f2-cddea3ceac4c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35346599-c7ee-4913-ac80-b4f1587b6a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:25 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Volume volume-0902028c-d58d-414f-97f2-cddea3ceac4c (0902028c-d58d-414f-97f2-cddea3ceac4c): created successfully Sep 30 19:40:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35346599-c7ee-4913-ac80-b4f1587b6a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Flow 'volume_create_manager' (367633a6-1818-4ceb-854e-07deff6889a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:25 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6bb4db6c-95d4-478c-9ee6-f68763cfd0cc tempest-VolumesTestJSON-2035998515 None] Created volume successfully. Sep 30 19:40:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Acquiring lock "cinder-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "cinder-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Acquiring lock "cinder-quobyte-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "cinder-quobyte-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:26 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af44fb0-7de5-4cd3-9ad6-59f7b2703b83]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:26 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 Sep 30 19:40:26 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Flow 'volume_create_manager' (a4646bce-b651-4e8f-9714-c356ad63a2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e9d988-580a-4548-a075-4214782568db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e9d988-580a-4548-a075-4214782568db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1462845419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99408039-0c84-4372-979e-6f98749423da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7249549094321bf74bdeda991bed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:27Z,use_quota=True,user_id='e2ff9475ac08424caa26d91473f168d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a9fe62-319c-4da7-92f0-4efc9bae9df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:27 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a9fe62-319c-4da7-92f0-4efc9bae9df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4f936d-aad1-4e12-8e7a-e31bc6f8df25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4f936d-aad1-4e12-8e7a-e31bc6f8df25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99408039-0c84-4372-979e-6f98749423da', 'volume_name': 'volume-99408039-0c84-4372-979e-6f98749423da', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9470f0c3-b500-4955-9d52-931d004dc80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9470f0c3-b500-4955-9d52-931d004dc80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540f8c91-bed7-4af5-a5f8-8e2c12811229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Volume 99408039-0c84-4372-979e-6f98749423da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99408039-0c84-4372-979e-6f98749423da', 'volume_size': 1} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1462845419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99408039-0c84-4372-979e-6f98749423da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfc7249549094321bf74bdeda991bed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:27Z,use_quota=True,user_id='e2ff9475ac08424caa26d91473f168d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Creating volume 99408039-0c84-4372-979e-6f98749423da {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:40:27 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524" returned: 0 in 0.779s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:27 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da 1073741824 Sep 30 19:40:27 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:27 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524 Sep 30 19:40:27 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:27 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524" returned: 0 in 0.538s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "cinder-quobyte-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524" released by "delete_volume" :: held 1.404s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Created reservations ['d066c17d-2a6e-44ad-b7b7-3f0495d5627e', '11180d37-f2b9-47d0-862a-47e1c4818e97', '5e714cc2-1a7c-4615-9ae1-397c56b2b8c3', '68b965ac-60db-4b00-94d6-b06043e4d023'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:28 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da 1073741824" returned: 0 in 0.957s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:28 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:40:28 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:28 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da Sep 30 19:40:28 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:28 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.382s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:40:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Deleted volume successfully. Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2bbc481c-7a05-41ac-8406-91eb8e0c0260 tempest-VolumeQuotasNegativeTestJSON-1608512788 None] Lock "cinder-6267ad1a-ea71-4eeb-8ad3-58c8bb5bc524-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:28 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da" returned: 0 in 0.409s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540f8c91-bed7-4af5-a5f8-8e2c12811229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99408039-0c84-4372-979e-6f98749423da', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a702335-a45b-40fb-8439-640fe6ac5cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:28 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Volume volume-99408039-0c84-4372-979e-6f98749423da (99408039-0c84-4372-979e-6f98749423da): created successfully Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a702335-a45b-40fb-8439-640fe6ac5cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Flow 'volume_create_manager' (a4646bce-b651-4e8f-9714-c356ad63a2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-56a7178d-b67f-470d-8f78-19cc72af12da tempest-VolumesTestJSON-2035998515 None] Created volume successfully. Sep 30 19:40:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "cinder-99408039-0c84-4372-979e-6f98749423da-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-99408039-0c84-4372-979e-6f98749423da-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "cinder-quobyte-99408039-0c84-4372-979e-6f98749423da" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-quobyte-99408039-0c84-4372-979e-6f98749423da" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:31 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8af327-7998-400a-8d2d-0e3c8f18a7e4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:32 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da Sep 30 19:40:32 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:32 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da" returned: 0 in 0.700s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:32 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da Sep 30 19:40:32 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:32 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-99408039-0c84-4372-979e-6f98749423da" returned: 0 in 0.396s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-quobyte-99408039-0c84-4372-979e-6f98749423da" released by "delete_volume" :: held 1.169s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Created reservations ['ced45bc1-c7c8-4cae-b088-cd5557f6568b', 'eef386cb-8e21-4427-b0fb-e53bb07a2caf', 'd4d2dd67-7b04-4758-88f9-ae50e0bbb816', '3801c0ae-bcc2-42f8-85a3-f6c6b3efd751'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:33 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:40:33 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:33 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.277s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:40:33 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Deleted volume successfully. Sep 30 19:40:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-47c2cf09-b830-46b5-8df2-8582099a4ea9 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-99408039-0c84-4372-979e-6f98749423da-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "cinder-0902028c-d58d-414f-97f2-cddea3ceac4c-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-0902028c-d58d-414f-97f2-cddea3ceac4c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "cinder-quobyte-0902028c-d58d-414f-97f2-cddea3ceac4c" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-quobyte-0902028c-d58d-414f-97f2-cddea3ceac4c" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:34 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ff81b1-adf6-4a5c-8c77-725953fd1679]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:34 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c Sep 30 19:40:34 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:34 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c" returned: 0 in 0.471s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:34 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c Sep 30 19:40:34 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:35 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0902028c-d58d-414f-97f2-cddea3ceac4c" returned: 0 in 0.349s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-quobyte-0902028c-d58d-414f-97f2-cddea3ceac4c" released by "delete_volume" :: held 0.878s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Created reservations ['9f653f32-325a-48f0-b535-5cc9f88caeb8', '1438c4f9-cc71-4b1f-b708-c642a1f62ba0', 'beea239b-6c62-4b8d-b6f9-be8f9bb1d6fc', 'fff7c6cd-e476-4560-99b9-0862c8dc59f0'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "cinder-d53c9acd-b2f6-4911-abf7-9be4f221b7f3-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:35 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:40:35 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-d53c9acd-b2f6-4911-abf7-9be4f221b7f3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "cinder-quobyte-d53c9acd-b2f6-4911-abf7-9be4f221b7f3" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-quobyte-d53c9acd-b2f6-4911-abf7-9be4f221b7f3" acquired by "delete_volume" :: waited 0.032s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc907f5-7aad-4afe-98ed-a093ae69526a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:35 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.443s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:40:35 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Deleted volume successfully. Sep 30 19:40:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6349aefc-c95d-4b7b-968a-de0f213ae778 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-0902028c-d58d-414f-97f2-cddea3ceac4c-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:35 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 Sep 30 19:40:35 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:36 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3" returned: 0 in 0.492s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:36 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3 Sep 30 19:40:36 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:36 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d53c9acd-b2f6-4911-abf7-9be4f221b7f3" returned: 0 in 0.331s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-quobyte-d53c9acd-b2f6-4911-abf7-9be4f221b7f3" released by "delete_volume" :: held 0.890s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Created reservations ['fde41185-d3b7-4379-a83b-44bcfdaff261', '300c0594-6eb8-4ad3-8638-9d4d5ec3bc97', '794dbd28-d539-4cd0-9224-b85f422c5be4', 'd655ba68-d3aa-4cf8-882a-91a8255ec6d6'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:36 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:40:36 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:36 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.280s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:36 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:40:36 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Deleted volume successfully. Sep 30 19:40:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3081acfa-43fe-48ae-86f1-722851ce43b5 tempest-VolumesTestJSON-2035998515 None] Lock "cinder-d53c9acd-b2f6-4911-abf7-9be4f221b7f3-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d1b21f1c-73e9-4a29-85ce-1051937cf45d tempest-GroupsV320Test-634614647 None] Group tempest-GroupsV320Test-Group-2045657729: creating Sep 30 19:40:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d1b21f1c-73e9-4a29-85ce-1051937cf45d tempest-GroupsV320Test-634614647 None] Group tempest-GroupsV320Test-Group-2045657729: created successfully Sep 30 19:40:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d1b21f1c-73e9-4a29-85ce-1051937cf45d tempest-GroupsV320Test-634614647 None] Create group completed successfully. Sep 30 19:40:47 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] Created reservations ['0eb7e5a8-b5d1-4934-aea8-69c5ec37301a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:47 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:40:47 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:47 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.300s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:47 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:40:47 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-41cf610f-6e21-4f48-903b-a8718076e0cd tempest-GroupsV320Test-634614647 None] Delete group completed successfully. Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Flow 'volume_create_manager' (8888d3ac-5eb0-4c99-a1fd-3f73950be78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71685de7-efd5-4086-bda2-82ce423b64d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71685de7-efd5-4086-bda2-82ce423b64d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-613706184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c886ef1-43c6-4e1f-88ef-2674dd9bd963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb8954f19b4a9d9394723e7bb5cb3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:57Z,use_quota=True,user_id='558f179c2291477f964643cdeafa4564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1517654-30d7-4c52-b117-dc31bc68bee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1517654-30d7-4c52-b117-dc31bc68bee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12282549-20b7-472f-8c72-2ccb8cdf3c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12282549-20b7-472f-8c72-2ccb8cdf3c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c886ef1-43c6-4e1f-88ef-2674dd9bd963', 'volume_name': 'volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cbb0b9-5d7b-4b2f-a46b-bfe076f2a7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cbb0b9-5d7b-4b2f-a46b-bfe076f2a7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5089814-87bd-4bc7-9695-e34d63441696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Volume 5c886ef1-43c6-4e1f-88ef-2674dd9bd963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963', 'volume_size': 1} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-613706184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c886ef1-43c6-4e1f-88ef-2674dd9bd963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb8954f19b4a9d9394723e7bb5cb3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:57Z,use_quota=True,user_id='558f179c2291477f964643cdeafa4564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Creating volume 5c886ef1-43c6-4e1f-88ef-2674dd9bd963 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:40:56 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:40:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:56 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 1073741824 Sep 30 19:40:56 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-79e74220-b4f8-4793-bb14-9fd35fae2f34 tempest-ServerActionsTestOtherA-178048750 None] Terminate volume connection completed successfully. Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-79e74220-b4f8-4793-bb14-9fd35fae2f34 tempest-ServerActionsTestOtherA-178048750 None] Deleting attachment 00f0626a-69ba-445a-a572-c6d450248998. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:40:57 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 1073741824" returned: 0 in 0.610s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:57 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 Sep 30 19:40:57 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "cinder-60d47a3a-151c-440b-9d99-941c163bacdc-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Lock "cinder-60d47a3a-151c-440b-9d99-941c163bacdc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:57 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963" returned: 0 in 0.367s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5089814-87bd-4bc7-9695-e34d63441696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e8e7eb-acdc-4c92-b9b6-073a991129a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Volume volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 (5c886ef1-43c6-4e1f-88ef-2674dd9bd963): created successfully Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e8e7eb-acdc-4c92-b9b6-073a991129a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Flow 'volume_create_manager' (8888d3ac-5eb0-4c99-a1fd-3f73950be78b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "cinder-quobyte-60d47a3a-151c-440b-9d99-941c163bacdc" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7d7bab7d-3266-48ec-a092-4759729f9547 tempest-VolumesListAdminTestJSON-1176870693 None] Created volume successfully. Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Lock "cinder-quobyte-60d47a3a-151c-440b-9d99-941c163bacdc" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec12e88-e158-48c2-a128-a12273aae801]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Flow 'volume_create_manager' (9a1c4f17-0711-4806-9151-417d07661b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ec818e-a05f-4552-a2e9-5a4c960c04a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ec818e-a05f-4552-a2e9-5a4c960c04a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1062240565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347288f3-d240-4832-a4f3-eb3713544d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ffa624d654b5f97cec3407bbf5cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:58Z,use_quota=True,user_id='f165a34ad2114cc2bb0b7c11e6bcd3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b869288a-6eeb-4e0f-92af-ba0176204b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b869288a-6eeb-4e0f-92af-ba0176204b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19309eb-45dd-406b-9480-fc7ffc25dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19309eb-45dd-406b-9480-fc7ffc25dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '347288f3-d240-4832-a4f3-eb3713544d9c', 'volume_name': 'volume-347288f3-d240-4832-a4f3-eb3713544d9c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b426f0df-4bf6-4497-98c9-5f5a95b8e50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b426f0df-4bf6-4497-98c9-5f5a95b8e50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f68e3e-ca92-43c8-924e-566a7df97efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:58 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Volume 347288f3-d240-4832-a4f3-eb3713544d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-347288f3-d240-4832-a4f3-eb3713544d9c', 'volume_size': 1} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1062240565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347288f3-d240-4832-a4f3-eb3713544d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ffa624d654b5f97cec3407bbf5cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:40:58Z,use_quota=True,user_id='f165a34ad2114cc2bb0b7c11e6bcd3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Creating volume 347288f3-d240-4832-a4f3-eb3713544d9c {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:58 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:58 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:40:58 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:58 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c 1073741824 Sep 30 19:40:58 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:58 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc" returned: 0 in 0.436s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:58 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc Sep 30 19:40:58 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:58 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c 1073741824" returned: 0 in 0.552s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:58 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c Sep 30 19:40:58 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:58 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-60d47a3a-151c-440b-9d99-941c163bacdc" returned: 0 in 0.369s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Lock "cinder-quobyte-60d47a3a-151c-440b-9d99-941c163bacdc" released by "delete_volume" :: held 0.885s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "cinder-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Lock "cinder-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.quota [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Created reservations ['e88f2771-26d2-41b3-a7aa-8266a25cc08c', '9aa1d21c-8957-4d81-b7cc-8bd020e28d60', '337480f0-6576-4c23-8164-f754011406cb', '61281a20-9a7a-412e-a38b-0e9b51df25f6'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "cinder-quobyte-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Lock "cinder-quobyte-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa" acquired by "delete_volume" :: waited 0.041s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:59 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c" returned: 0 in 0.299s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5c5bf7-6de6-4c42-a03b-4e29ef4269e8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f68e3e-ca92-43c8-924e-566a7df97efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-347288f3-d240-4832-a4f3-eb3713544d9c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0a79b1-f00c-4795-ae9d-108e8f9b79f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:59 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Volume volume-347288f3-d240-4832-a4f3-eb3713544d9c (347288f3-d240-4832-a4f3-eb3713544d9c): created successfully Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0a79b1-f00c-4795-ae9d-108e8f9b79f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Flow 'volume_create_manager' (9a1c4f17-0711-4806-9151-417d07661b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:59 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-35c0a61d-a057-4c68-bd00-2f291b97d79a tempest-VolumeQuotasAdminTestJSON-917072935 None] Created volume successfully. Sep 30 19:40:59 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:40:59 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:59 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa Sep 30 19:40:59 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:59 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.409s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.manager [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:40:59 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Deleted volume successfully. Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-987ee760-0e7a-414f-87d0-dbc8e0764fe5 req-7589cd19-79d3-49f7-b178-52e3e1ded8b9 tempest-ServerActionsTestOtherA-178048750 None] Lock "cinder-60d47a3a-151c-440b-9d99-941c163bacdc-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Acquiring lock "cinder-347288f3-d240-4832-a4f3-eb3713544d9c-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:59 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa" returned: 0 in 0.554s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "cinder-347288f3-d240-4832-a4f3-eb3713544d9c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:59 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa Sep 30 19:40:59 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Flow 'volume_create_manager' (0c80eefb-dfdf-4a63-87cf-ec861f95a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16dcbc30-8a09-4db6-88eb-6340c0edd6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16dcbc30-8a09-4db6-88eb-6340c0edd6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-967709178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef34f9d468c64202acd9a71572798eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:00Z,use_quota=True,user_id='301a50acca584cd8a803f8f4b71d7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed48ab5-f1a9-42c0-882b-f9520d21990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed48ab5-f1a9-42c0-882b-f9520d21990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e228620-78cb-4422-8e09-a0f3a12cdec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e228620-78cb-4422-8e09-a0f3a12cdec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa', 'volume_name': 'volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5fad34-1d4c-41c1-9431-36cd7e5dc37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5fad34-1d4c-41c1-9431-36cd7e5dc37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868947b3-dd6a-4d88-8519-ae91c7c8d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Volume 9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa', 'volume_size': 1} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-967709178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef34f9d468c64202acd9a71572798eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:00Z,use_quota=True,user_id='301a50acca584cd8a803f8f4b71d7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Creating volume 9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:40:59 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Acquiring lock "cinder-quobyte-347288f3-d240-4832-a4f3-eb3713544d9c" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:40:59 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa 1073741824 Sep 30 19:40:59 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "cinder-quobyte-347288f3-d240-4832-a4f3-eb3713544d9c" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Flow 'volume_create_manager' (45f18207-70c0-48b1-99d1-2697d6ec480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb28e57-0e1b-42ab-b667-58a3c6b119ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed6d87f-e6d4-499b-8faa-45e5eb8a24f0]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb28e57-0e1b-42ab-b667-58a3c6b119ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-975809655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ca9286-2fc7-4af9-80cf-ed704602c027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb8954f19b4a9d9394723e7bb5cb3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:00Z,use_quota=True,user_id='558f179c2291477f964643cdeafa4564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:59 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abe0b25-7239-4dcb-8cf0-82484acdda5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abe0b25-7239-4dcb-8cf0-82484acdda5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb6ad38-1784-4844-a893-e5ca31edea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb6ad38-1784-4844-a893-e5ca31edea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ca9286-2fc7-4af9-80cf-ed704602c027', 'volume_name': 'volume-29ca9286-2fc7-4af9-80cf-ed704602c027', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300202b1-da2b-4130-a5b5-745305aedc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:40:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300202b1-da2b-4130-a5b5-745305aedc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c0c9e4-41f8-4d8b-b493-bc3e49b87a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:00 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Volume 29ca9286-2fc7-4af9-80cf-ed704602c027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ca9286-2fc7-4af9-80cf-ed704602c027', 'volume_size': 1} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa" returned: 0 in 0.318s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Lock "cinder-quobyte-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa" released by "delete_volume" :: held 0.927s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:00 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c Sep 30 19:41:00 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Created reservations ['7b411141-4acf-4010-966e-81ca8bb4ab1e', '562d0bae-43dd-4694-8d44-b1391f1733bd', '78a6099f-4223-47f0-a391-28bfe48d3df9', '728a73ae-3557-498b-ae79-93c621479553'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:00 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:00 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:00 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa 1073741824" returned: 0 in 0.473s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:00 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa Sep 30 19:41:00 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:00 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c" returned: 0 in 0.444s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:00 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c Sep 30 19:41:00 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:00 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Deleted volume successfully. Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0a2e55c-1dcb-4bba-ab05-62ae9203477e tempest-ServerActionsTestOtherA-178048750 None] Lock "cinder-e3fbc907-2dd4-4a60-82ea-f9b7b0acbbaa-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:00 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" returned: 0 in 0.308s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-975809655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ca9286-2fc7-4af9-80cf-ed704602c027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb8954f19b4a9d9394723e7bb5cb3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:00Z,use_quota=True,user_id='558f179c2291477f964643cdeafa4564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Creating volume 29ca9286-2fc7-4af9-80cf-ed704602c027 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:00 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868947b3-dd6a-4d88-8519-ae91c7c8d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650b4a49-0b97-4da4-be72-931344dc158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:00 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027 1073741824 Sep 30 19:41:00 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:00 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-347288f3-d240-4832-a4f3-eb3713544d9c" returned: 0 in 0.342s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "cinder-quobyte-347288f3-d240-4832-a4f3-eb3713544d9c" released by "delete_volume" :: held 0.865s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:00 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Volume volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa (9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa): created successfully Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650b4a49-0b97-4da4-be72-931344dc158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Flow 'volume_create_manager' (0c80eefb-dfdf-4a63-87cf-ec861f95a915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-efdfd998-c3a3-4d00-91c0-de2898d6f753 tempest-SnapshotMetadataTestJSON-1704461675 None] Created volume successfully. Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Created reservations ['d6e898a1-3217-4fb5-b8ea-bf31d68f3665', '9dcc2957-0c8f-4ff4-8341-2fc65b918816', 'c887f735-aaea-4681-ada7-a555659f2e54', 'c6a815d9-3572-4604-a0f0-3af34eec67db'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:00 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:00 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:01 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.280s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:01 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Deleted volume successfully. Sep 30 19:41:01 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027 1073741824" returned: 0 in 0.678s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-994e6d77-a6bf-4134-a402-3fecfe344ec3 tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "cinder-347288f3-d240-4832-a4f3-eb3713544d9c-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:01 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027 Sep 30 19:41:01 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:01 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027" returned: 0 in 0.329s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c0c9e4-41f8-4d8b-b493-bc3e49b87a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ca9286-2fc7-4af9-80cf-ed704602c027', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ec0e51-7f8c-41e8-b877-f1d0c7da3bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:01 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Volume volume-29ca9286-2fc7-4af9-80cf-ed704602c027 (29ca9286-2fc7-4af9-80cf-ed704602c027): created successfully Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ec0e51-7f8c-41e8-b877-f1d0c7da3bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Flow 'volume_create_manager' (45f18207-70c0-48b1-99d1-2697d6ec480b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:01 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-965bac06-c836-4163-a948-0db34368cf62 tempest-VolumesListAdminTestJSON-1176870693 None] Created volume successfully. Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Creating offline snapshot 2f2c51b2-75e8-4261-98b9-d637b89d01af of volume 9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a71e60-197e-4ed3-8c1c-62ebff066e23]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:02 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa Sep 30 19:41:02 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:02 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" returned: 0 in 0.486s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:02 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af 1G Sep 30 19:41:02 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Flow 'volume_create_manager' (19640b0d-66b6-4512-a9ef-40a623798370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bce33aa-6fcc-486c-ba77-f817f09a5f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bce33aa-6fcc-486c-ba77-f817f09a5f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1141087709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e51681-5bab-4a5b-b54a-0bd0e248aca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ffa624d654b5f97cec3407bbf5cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:03Z,use_quota=True,user_id='f165a34ad2114cc2bb0b7c11e6bcd3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8c6df2-0430-48ac-bac0-076edc213c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8c6df2-0430-48ac-bac0-076edc213c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1de3b0-e6f1-4767-b0fd-8b66349141c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1de3b0-e6f1-4767-b0fd-8b66349141c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e51681-5bab-4a5b-b54a-0bd0e248aca3', 'volume_name': 'volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f82b66-a716-4abd-b8f2-ce44dd0bd9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f82b66-a716-4abd-b8f2-ce44dd0bd9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484f5f7c-4163-46e0-900d-4b9788bd19b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:02 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Volume e9e51681-5bab-4a5b-b54a-0bd0e248aca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3', 'volume_size': 1} Sep 30 19:41:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:03 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af 1G" returned: 0 in 0.539s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:03 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af Sep 30 19:41:03 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:03 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af" returned: 0 in 0.376s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:03 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af is being set with open permissions: ugo+rw Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:03 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af Sep 30 19:41:03 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Flow 'volume_create_manager' (a9201ea9-0e7f-49c1-929d-5754bf9b0c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2d2cb4-d9da-4562-92a8-4a5d9424f41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2d2cb4-d9da-4562-92a8-4a5d9424f41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1698239688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41f7041-5395-4ff3-87c4-dcca90c8e8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb8954f19b4a9d9394723e7bb5cb3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:03Z,use_quota=True,user_id='558f179c2291477f964643cdeafa4564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3a415d-eddb-46c3-b106-d1fa4736b532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3a415d-eddb-46c3-b106-d1fa4736b532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645fb032-6cb0-47d3-810c-7eae4ff7fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645fb032-6cb0-47d3-810c-7eae4ff7fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41f7041-5395-4ff3-87c4-dcca90c8e8df', 'volume_name': 'volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdb2055-d555-48a5-a330-01f3ab2a0355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdb2055-d555-48a5-a330-01f3ab2a0355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c9aac5-4387-4b3b-8220-764808a7ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:03 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Volume e41f7041-5395-4ff3-87c4-dcca90c8e8df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df', 'volume_size': 1} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:03 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:03 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.info Sep 30 19:41:03 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:04 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.info" returned: 0 in 0.268s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:04 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.info is being set with open permissions: ugo+rw Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:04 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.info Sep 30 19:41:04 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:04 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.info" returned: 0 in 0.244s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.312s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1141087709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e51681-5bab-4a5b-b54a-0bd0e248aca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992ffa624d654b5f97cec3407bbf5cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:03Z,use_quota=True,user_id='f165a34ad2114cc2bb0b7c11e6bcd3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Creating volume e9e51681-5bab-4a5b-b54a-0bd0e248aca3 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:04 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:04 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 1073741824 Sep 30 19:41:04 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:04 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-210676b6-4624-49a6-bdf0-b9a0aedb60a4 tempest-SnapshotMetadataTestJSON-1704461675 None] Create snapshot completed successfully Sep 30 19:41:04 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 1073741824" returned: 0 in 0.456s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:04 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 Sep 30 19:41:04 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:05 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3" returned: 0 in 0.266s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1698239688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41f7041-5395-4ff3-87c4-dcca90c8e8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eeb8954f19b4a9d9394723e7bb5cb3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:03Z,use_quota=True,user_id='558f179c2291477f964643cdeafa4564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Creating volume e41f7041-5395-4ff3-87c4-dcca90c8e8df {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:05 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:05 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df 1073741824 Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484f5f7c-4163-46e0-900d-4b9788bd19b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:05 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328a691a-b661-49e2-b71d-495ccac68431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:05 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Volume volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 (e9e51681-5bab-4a5b-b54a-0bd0e248aca3): created successfully Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328a691a-b661-49e2-b71d-495ccac68431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Flow 'volume_create_manager' (19640b0d-66b6-4512-a9ef-40a623798370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:05 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-4b46167b-96aa-4e37-96fe-6ad55bdc609c tempest-VolumeQuotasAdminTestJSON-917072935 None] Created volume successfully. Sep 30 19:41:05 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df 1073741824" returned: 0 in 0.587s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:05 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df Sep 30 19:41:05 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Acquiring lock "cinder-2f2c51b2-75e8-4261-98b9-d637b89d01af-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-2f2c51b2-75e8-4261-98b9-d637b89d01af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Acquiring lock "cinder-quobyte-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-quobyte-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Acquiring lock "cinder-quobyte-2f2c51b2-75e8-4261-98b9-d637b89d01af" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-quobyte-2f2c51b2-75e8-4261-98b9-d637b89d01af" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Deleting offline snapshot 2f2c51b2-75e8-4261-98b9-d637b89d01af of volume 9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:41:06 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] snapshot_file for this snap is: volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df" returned: 0 in 0.383s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c9aac5-4387-4b3b-8220-764808a7ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab8cb37-a37d-402c-b17f-ed4762009ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f53bcbe-a918-4fc0-ab1b-8500681146b0]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:06 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Volume volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df (e41f7041-5395-4ff3-87c4-dcca90c8e8df): created successfully Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab8cb37-a37d-402c-b17f-ed4762009ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Flow 'volume_create_manager' (a9201ea9-0e7f-49c1-929d-5754bf9b0c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:06 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2c58828d-cd5a-4577-957b-9c2d103dba0c tempest-VolumesListAdminTestJSON-1176870693 None] Created volume successfully. Sep 30 19:41:06 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af Sep 30 19:41:06 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:06 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af" returned: 0 in 0.460s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8518e7d4-4377-4ac3-8bcd-48423b1b8934]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:06 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-59eed821-6780-4cc6-82c2-ce2172fca0d4 tempest-VolumeQuotasAdminTestJSON-607241969 None] Transfer volume completed successfully. Sep 30 19:41:06 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa Sep 30 19:41:06 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:07 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" returned: 0 in 0.526s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:07 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af Sep 30 19:41:07 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Acquiring lock "cinder-e9e51681-5bab-4a5b-b54a-0bd0e248aca3-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Lock "cinder-e9e51681-5bab-4a5b-b54a-0bd0e248aca3-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Acquiring lock "cinder-quobyte-e9e51681-5bab-4a5b-b54a-0bd0e248aca3" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Lock "cinder-quobyte-e9e51681-5bab-4a5b-b54a-0bd0e248aca3" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e930c6-18af-48c0-95b1-f01e797a5060]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:07 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 Sep 30 19:41:07 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:07 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af" returned: 0 in 0.507s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:07 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af Sep 30 19:41:07 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Flow 'volume_create_manager' (841b0cc2-bc83-409d-b935-26aba4d4f8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4109a0ab-2d4b-4272-836d-715692b671be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4109a0ab-2d4b-4272-836d-715692b671be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf1e83d-1fa2-47f6-91eb-4098216adf1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bc4780a0de40a7936bb64046225679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:08Z,use_quota=True,user_id='ce9907479f9d4fda8847604d4751303c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79868efb-b928-46c4-bcf5-dc22d2f48a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79868efb-b928-46c4-bcf5-dc22d2f48a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f4c67b-3e5b-4546-910f-e6f6fc5d3f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f4c67b-3e5b-4546-910f-e6f6fc5d3f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf1e83d-1fa2-47f6-91eb-4098216adf1b', 'volume_name': 'volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a24906-2f10-4e59-a73f-b8678418ec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a24906-2f10-4e59-a73f-b8678418ec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f90129-c5d2-45af-9782-eba8514af478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:07 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Volume 8bf1e83d-1fa2-47f6-91eb-4098216adf1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b', 'volume_size': 1} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf1e83d-1fa2-47f6-91eb-4098216adf1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bc4780a0de40a7936bb64046225679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:08Z,use_quota=True,user_id='ce9907479f9d4fda8847604d4751303c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Creating volume 8bf1e83d-1fa2-47f6-91eb-4098216adf1b {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:07 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:07 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa.2f2c51b2-75e8-4261-98b9-d637b89d01af" returned: 0 in 0.276s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:07 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b 1073741824 Sep 30 19:41:07 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:07 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3" returned: 0 in 0.459s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-quobyte-2f2c51b2-75e8-4261-98b9-d637b89d01af" released by "_delete_snapshot" :: held 1.947s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-quobyte-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" released by "delete_snapshot" :: held 1.983s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:07 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3 Sep 30 19:41:07 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Created reservations ['4910f990-2a92-476b-87e2-2a528c18c912', '1feede65-54e3-4a64-bd5f-85b96098cde5', '01887f84-5acd-4822-8345-8c55456e37c2', '5c9b91d4-03ab-4163-b02a-106b6ff5ff22'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:08 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Delete snapshot completed successfully. Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2116a447-25ee-4ea2-bfad-bd7ff79f8c75 tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-2f2c51b2-75e8-4261-98b9-d637b89d01af-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Acquiring lock "cinder-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:08 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e9e51681-5bab-4a5b-b54a-0bd0e248aca3" returned: 0 in 0.444s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Lock "cinder-quobyte-e9e51681-5bab-4a5b-b54a-0bd0e248aca3" released by "delete_volume" :: held 0.995s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Acquiring lock "cinder-quobyte-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-quobyte-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:08 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b 1073741824" returned: 0 in 0.674s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Created reservations ['6fd414d1-6e0c-4120-8f68-0d67f942ec8a', 'c52fefa4-4d2f-4d2a-967c-daf43a415cde', '983a56ad-ee18-487e-bc58-8c4cc1464002', 'c610a7dd-2ac6-4100-99cb-d1f9b34551e5'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf4a00-ee63-4d87-92c6-aea8ed55768b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:08 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b Sep 30 19:41:08 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:08 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa Sep 30 19:41:08 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:08 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:08 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:08 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b" returned: 0 in 0.316s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f90129-c5d2-45af-9782-eba8514af478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace254bf-2d59-45b2-ad11-008a4a65694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:08 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:08 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Volume volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b (8bf1e83d-1fa2-47f6-91eb-4098216adf1b): created successfully Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace254bf-2d59-45b2-ad11-008a4a65694e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Flow 'volume_create_manager' (841b0cc2-bc83-409d-b935-26aba4d4f8b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" returned: 0 in 0.425s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:09 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2680559f-5736-48f2-89c0-99f6149d3211 tempest-VolumesListAdminTestJSON-958586437 None] Created volume successfully. Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.329s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:09 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa Sep 30 19:41:09 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Deleted volume successfully. Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-52085cbf-0ed8-4854-a64e-e26f00673292 tempest-VolumeQuotasAdminTestJSON-150918653 None] Lock "cinder-e9e51681-5bab-4a5b-b54a-0bd0e248aca3-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:09 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" returned: 0 in 0.275s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-quobyte-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa" released by "delete_volume" :: held 0.780s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Created reservations ['799d180a-010b-421a-85de-08c249cb5d83', 'ee6b63a6-861c-4ec0-8fbf-1d60de86163d', '574bab45-38b3-4cbf-8efd-68004e427cea', '9b0942a2-2061-491d-9efd-6fe446b651ef'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:09 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:09 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:09 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.313s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Deleted volume successfully. Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=102,cinder:INSERT=33,cinder:UPDATE=132,cinder:DELETE=10 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:41:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b0326f10-b319-428b-907f-cccfa94cb03c tempest-SnapshotMetadataTestJSON-1704461675 None] Lock "cinder-9094c4ed-e679-4a79-a4ee-bfbfdb3cadfa-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Acquiring lock "cinder-8bf1e83d-1fa2-47f6-91eb-4098216adf1b-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Lock "cinder-8bf1e83d-1fa2-47f6-91eb-4098216adf1b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=112,cinder:INSERT=28,cinder:UPDATE=140,cinder:DELETE=12 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Acquiring lock "cinder-quobyte-8bf1e83d-1fa2-47f6-91eb-4098216adf1b" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Lock "cinder-quobyte-8bf1e83d-1fa2-47f6-91eb-4098216adf1b" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "cinder-e41f7041-5395-4ff3-87c4-dcca90c8e8df-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6179364d-1025-4fe5-98c3-ca12a1b0081f]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-e41f7041-5395-4ff3-87c4-dcca90c8e8df-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "cinder-quobyte-e41f7041-5395-4ff3-87c4-dcca90c8e8df" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-quobyte-e41f7041-5395-4ff3-87c4-dcca90c8e8df" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[91acb908-d6cb-49b4-a57f-87c11029ddb1]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:10 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b Sep 30 19:41:10 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:10 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df Sep 30 19:41:10 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:10 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b" returned: 0 in 0.523s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:10 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b Sep 30 19:41:10 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:11 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df" returned: 0 in 0.590s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:11 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df Sep 30 19:41:11 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:11 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8bf1e83d-1fa2-47f6-91eb-4098216adf1b" returned: 0 in 0.431s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Lock "cinder-quobyte-8bf1e83d-1fa2-47f6-91eb-4098216adf1b" released by "delete_volume" :: held 1.054s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:11 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e41f7041-5395-4ff3-87c4-dcca90c8e8df" returned: 0 in 0.375s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-quobyte-e41f7041-5395-4ff3-87c4-dcca90c8e8df" released by "delete_volume" :: held 1.050s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Created reservations ['8128a9f5-5478-45ba-874c-3fad625182f9', 'a090c85e-966f-4eac-9bce-4d6034203e60', 'f8e80609-5eab-4fcf-a085-c8f687435f66', '147bd785-de9c-4d02-a236-5e51b1b62a8c'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Created reservations ['4f640bc2-439a-41c9-9855-bfa8553a99fc', 'b2a6abc4-0f5d-4499-be35-907dfcb49603', 'fd9c811d-9887-49cc-ad7d-8bb9c786c55b', 'b5d7e6a4-9216-42f4-9990-a59823a72370'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:11 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:11 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:11 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:11 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:11 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.360s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Deleted volume successfully. Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dd1997f3-1e3d-424d-aaa1-9e4afc2731ad tempest-VolumesListAdminTestJSON-958586437 None] Lock "cinder-8bf1e83d-1fa2-47f6-91eb-4098216adf1b-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:12 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.355s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Deleted volume successfully. Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-55f7f59a-8957-4417-8dcf-3ffdd2ce9697 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-e41f7041-5395-4ff3-87c4-dcca90c8e8df-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "cinder-29ca9286-2fc7-4af9-80cf-ed704602c027-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-29ca9286-2fc7-4af9-80cf-ed704602c027-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "cinder-quobyte-29ca9286-2fc7-4af9-80cf-ed704602c027" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-quobyte-29ca9286-2fc7-4af9-80cf-ed704602c027" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207209b-295c-4c3d-aaf2-b66c19b4271d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:13 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027 Sep 30 19:41:13 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:13 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027" returned: 0 in 0.497s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:13 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027 Sep 30 19:41:13 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:13 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-29ca9286-2fc7-4af9-80cf-ed704602c027" returned: 0 in 0.295s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-quobyte-29ca9286-2fc7-4af9-80cf-ed704602c027" released by "delete_volume" :: held 0.854s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:13 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Created reservations ['8622009d-eb2d-4ba9-84ff-e50275a6e84b', 'a02d1c9b-e5bb-4dd6-8fbc-b3d64c5a084d', '3506426b-4620-4d97-ad5f-965beaad3482', '8893df1d-b966-4271-9128-f0d357cd9e75'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:14 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:14 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:14 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.290s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:14 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:14 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Deleted volume successfully. Sep 30 19:41:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c0da2bd-6266-4d85-9d9e-6d1cc5579310 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-29ca9286-2fc7-4af9-80cf-ed704602c027-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "cinder-5c886ef1-43c6-4e1f-88ef-2674dd9bd963-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-5c886ef1-43c6-4e1f-88ef-2674dd9bd963-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "cinder-quobyte-5c886ef1-43c6-4e1f-88ef-2674dd9bd963" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-quobyte-5c886ef1-43c6-4e1f-88ef-2674dd9bd963" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:15 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0a2c00-8337-42fe-bd9c-5bd4cf4587cb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:15 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 Sep 30 19:41:15 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:15 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963" returned: 0 in 0.458s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:15 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963 Sep 30 19:41:15 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:16 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5c886ef1-43c6-4e1f-88ef-2674dd9bd963" returned: 0 in 0.308s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-quobyte-5c886ef1-43c6-4e1f-88ef-2674dd9bd963" released by "delete_volume" :: held 0.831s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Created reservations ['bb5feba6-3f0f-43e2-bb98-3c3526bf8bcf', '262cf9bf-2822-41d5-a867-41bf0e602a7c', '7e25ca27-64ad-494c-bb21-54dd06d7b152', '46b883a9-6d93-4917-9251-745c14e37b76'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:16 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:16 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:16 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Deleted volume successfully. Sep 30 19:41:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d0fb792d-7555-46c9-9c8c-ec1d5406b2e3 tempest-VolumesListAdminTestJSON-1176870693 None] Lock "cinder-5c886ef1-43c6-4e1f-88ef-2674dd9bd963-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Flow 'volume_create_manager' (b3192246-645e-4fd0-8774-f6cd5f55245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc64294-205e-435b-bbef-665dfdccd669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc64294-205e-435b-bbef-665dfdccd669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-932150096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ae89da-60a8-40a5-8fdd-995eda93e232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91076c0fa49c44c38c719ca657854c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:17Z,use_quota=True,user_id='2b2fc47a76bd4ede8c10a6a33e575b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b994966-318f-4aff-a429-5534a77c7308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b994966-318f-4aff-a429-5534a77c7308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb993ea9-353a-4e4d-bb3e-fcafdee59bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb993ea9-353a-4e4d-bb3e-fcafdee59bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ae89da-60a8-40a5-8fdd-995eda93e232', 'volume_name': 'volume-52ae89da-60a8-40a5-8fdd-995eda93e232', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0694ca08-25e7-4e1c-be69-676aa2217ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0694ca08-25e7-4e1c-be69-676aa2217ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a031fe-473e-4ffc-8e82-8e1e5bcd093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:17 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Volume 52ae89da-60a8-40a5-8fdd-995eda93e232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ae89da-60a8-40a5-8fdd-995eda93e232', 'volume_size': 1} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-932150096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ae89da-60a8-40a5-8fdd-995eda93e232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91076c0fa49c44c38c719ca657854c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:17Z,use_quota=True,user_id='2b2fc47a76bd4ede8c10a6a33e575b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Creating volume 52ae89da-60a8-40a5-8fdd-995eda93e232 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:17 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:17 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232 1073741824 Sep 30 19:41:17 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:18 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232 1073741824" returned: 0 in 0.571s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:18 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232 Sep 30 19:41:18 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:18 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232" returned: 0 in 0.382s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a031fe-473e-4ffc-8e82-8e1e5bcd093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ae89da-60a8-40a5-8fdd-995eda93e232', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69e3aa5-af6d-450d-a3ca-ed54a2cbcb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:18 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Volume volume-52ae89da-60a8-40a5-8fdd-995eda93e232 (52ae89da-60a8-40a5-8fdd-995eda93e232): created successfully Sep 30 19:41:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69e3aa5-af6d-450d-a3ca-ed54a2cbcb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Flow 'volume_create_manager' (b3192246-645e-4fd0-8774-f6cd5f55245a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e2250498-f4c2-4b8e-8fcf-24362da368e7 tempest-VolumesTransfersTest-664014473 None] Created volume successfully. Sep 30 19:41:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e78aa80f-4c0f-4fc6-8998-1c3ea0850f4f tempest-VolumesTransfersTest-721477427 None] Transfer volume completed successfully. Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Flow 'volume_create_manager' (67460b6e-ae34-4557-8c39-a165bc5d1bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9511352-d358-4299-994a-9f22e7d45313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9511352-d358-4299-994a-9f22e7d45313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-658687084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132f9394-b908-4b6e-95ba-33d985b9ecec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9627c22dc614f3687d2629c5839d45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:21Z,use_quota=True,user_id='e1d6f2f2fedc49188f89a2a4dd3edb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93a8141-efcd-4bd3-a554-7eebeb4603d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93a8141-efcd-4bd3-a554-7eebeb4603d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa8dbbf-e811-4186-a056-c985da6725e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa8dbbf-e811-4186-a056-c985da6725e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132f9394-b908-4b6e-95ba-33d985b9ecec', 'volume_name': 'volume-132f9394-b908-4b6e-95ba-33d985b9ecec', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e116c95d-0168-48a5-abb2-ec2b2d1c3d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e116c95d-0168-48a5-abb2-ec2b2d1c3d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8902ae9e-e739-4f63-9905-9a256505ced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:21 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Volume 132f9394-b908-4b6e-95ba-33d985b9ecec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132f9394-b908-4b6e-95ba-33d985b9ecec', 'volume_size': 1} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-658687084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132f9394-b908-4b6e-95ba-33d985b9ecec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9627c22dc614f3687d2629c5839d45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:21Z,use_quota=True,user_id='e1d6f2f2fedc49188f89a2a4dd3edb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Creating volume 132f9394-b908-4b6e-95ba-33d985b9ecec {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:21 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:21 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec 1073741824 Sep 30 19:41:21 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Acquiring lock "cinder-52ae89da-60a8-40a5-8fdd-995eda93e232-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Lock "cinder-52ae89da-60a8-40a5-8fdd-995eda93e232-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Acquiring lock "cinder-quobyte-52ae89da-60a8-40a5-8fdd-995eda93e232" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Lock "cinder-quobyte-52ae89da-60a8-40a5-8fdd-995eda93e232" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:22 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec 1073741824" returned: 0 in 0.619s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[493eeb58-d8f1-4ffa-b811-ed75f02f4da8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:22 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec Sep 30 19:41:22 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:22 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232 Sep 30 19:41:22 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:22 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec" returned: 0 in 0.357s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8902ae9e-e739-4f63-9905-9a256505ced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132f9394-b908-4b6e-95ba-33d985b9ecec', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48befd65-cc3c-45ec-817e-95cd7617dba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:22 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Volume volume-132f9394-b908-4b6e-95ba-33d985b9ecec (132f9394-b908-4b6e-95ba-33d985b9ecec): created successfully Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48befd65-cc3c-45ec-817e-95cd7617dba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Flow 'volume_create_manager' (67460b6e-ae34-4557-8c39-a165bc5d1bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:22 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b417607b-7ca4-4f81-bef8-8336ff10cd17 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Created volume successfully. Sep 30 19:41:22 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232" returned: 0 in 0.548s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:22 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232 Sep 30 19:41:22 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:23 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-52ae89da-60a8-40a5-8fdd-995eda93e232" returned: 0 in 0.346s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Lock "cinder-quobyte-52ae89da-60a8-40a5-8fdd-995eda93e232" released by "delete_volume" :: held 0.975s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Created reservations ['690e0455-f178-4764-95a6-f1ec376cd683', 'f6b82d69-e618-4603-8289-e50dd01ea4a3', '6299b0de-c6e3-4cc5-9374-73b8e1be4f40', 'b84f803b-f42a-45df-b4d6-c3f28cbc377d'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:23 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:23 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:23 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.326s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:23 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Deleted volume successfully. Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6336199d-3489-46d2-a8fa-1e60e0c6862d tempest-VolumesTransfersTest-1289197287 None] Lock "cinder-52ae89da-60a8-40a5-8fdd-995eda93e232-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Creating offline snapshot a4a6eafb-0c37-4f98-b448-b3573bd97556 of volume 132f9394-b908-4b6e-95ba-33d985b9ecec {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a860c5-538e-4f1e-8d14-e588483abc6b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:23 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec Sep 30 19:41:23 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:23 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:23 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:24 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec" returned: 0 in 0.597s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:24 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.521s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:41:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:41:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:41:24 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 1G Sep 30 19:41:24 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:25 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 1G" returned: 0 in 0.716s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f9394-b908-4b6e-95ba-33d985b9ecec -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:25 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f9394-b908-4b6e-95ba-33d985b9ecec -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 Sep 30 19:41:25 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Flow 'volume_create_manager' (a623d4d1-88cc-4e81-89ab-f6b8708e5b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb2d020-1ce4-4596-a13a-b248347a1062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb2d020-1ce4-4596-a13a-b248347a1062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1820733463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4fd49e1-644f-4e59-9242-5a7f44698019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91076c0fa49c44c38c719ca657854c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:25Z,use_quota=True,user_id='2b2fc47a76bd4ede8c10a6a33e575b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aeb329b-6bb4-4d5f-8d84-c202cb4bad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aeb329b-6bb4-4d5f-8d84-c202cb4bad33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf97995-3c5d-4aa5-90e3-577046427e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf97995-3c5d-4aa5-90e3-577046427e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4fd49e1-644f-4e59-9242-5a7f44698019', 'volume_name': 'volume-d4fd49e1-644f-4e59-9242-5a7f44698019', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577e26d6-9ede-40a8-b244-0f57625a529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577e26d6-9ede-40a8-b244-0f57625a529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3575d283-f83f-4c1a-bd2a-1e7669627dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:25 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Volume d4fd49e1-644f-4e59-9242-5a7f44698019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4fd49e1-644f-4e59-9242-5a7f44698019', 'volume_size': 1} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:25 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f9394-b908-4b6e-95ba-33d985b9ecec -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556" returned: 0 in 0.386s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:25 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 is being set with open permissions: ugo+rw Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:25 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 Sep 30 19:41:25 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:25 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556" returned: 0 in 0.282s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:25 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.info Sep 30 19:41:25 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:26 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.info" returned: 0 in 0.306s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:26 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.info is being set with open permissions: ugo+rw Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:26 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.info Sep 30 19:41:26 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:26 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.info" returned: 0 in 0.285s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.716s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1820733463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4fd49e1-644f-4e59-9242-5a7f44698019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91076c0fa49c44c38c719ca657854c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:25Z,use_quota=True,user_id='2b2fc47a76bd4ede8c10a6a33e575b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Creating volume d4fd49e1-644f-4e59-9242-5a7f44698019 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:26 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:26 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019 1073741824 Sep 30 19:41:26 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:26 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b69ff036-5df2-4874-b331-12441770c2d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Create snapshot completed successfully Sep 30 19:41:27 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019 1073741824" returned: 0 in 0.634s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:27 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019 Sep 30 19:41:27 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Acquiring lock "cinder-a4a6eafb-0c37-4f98-b448-b3573bd97556-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-a4a6eafb-0c37-4f98-b448-b3573bd97556-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Acquiring lock "cinder-quobyte-132f9394-b908-4b6e-95ba-33d985b9ecec" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-quobyte-132f9394-b908-4b6e-95ba-33d985b9ecec" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Acquiring lock "cinder-quobyte-a4a6eafb-0c37-4f98-b448-b3573bd97556" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:27 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019" returned: 0 in 0.454s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-quobyte-a4a6eafb-0c37-4f98-b448-b3573bd97556" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Deleting offline snapshot a4a6eafb-0c37-4f98-b448-b3573bd97556 of volume 132f9394-b908-4b6e-95ba-33d985b9ecec {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] snapshot_file for this snap is: volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3575d283-f83f-4c1a-bd2a-1e7669627dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4fd49e1-644f-4e59-9242-5a7f44698019', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd03ed9b-ce89-4975-abe9-809ddb21f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[306a6d2d-3c36-4254-918f-4348d8320af0]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Volume volume-d4fd49e1-644f-4e59-9242-5a7f44698019 (d4fd49e1-644f-4e59-9242-5a7f44698019): created successfully Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd03ed9b-ce89-4975-abe9-809ddb21f168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Flow 'volume_create_manager' (a623d4d1-88cc-4e81-89ab-f6b8708e5b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-db0461a1-1871-42bc-b667-c01ad0575568 tempest-VolumesTransfersTest-664014473 None] Created volume successfully. Sep 30 19:41:27 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 Sep 30 19:41:27 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:27 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Flow 'volume_create_manager' (5036589a-df30-4013-883e-3d92a98e8ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721254e6-d9ea-4ed7-8d85-11445ba31b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721254e6-d9ea-4ed7-8d85-11445ba31b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-328551384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5345aea-b50b-4b69-b263-eb9be6563995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae11484bc234133bd05d8dc4f3f4d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:28Z,use_quota=True,user_id='eed1e502105a487f97a2258cff74189b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0bc3dc-7cb2-4737-b438-abd2017ee9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0bc3dc-7cb2-4737-b438-abd2017ee9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37a7d52-ea9b-47bf-bddc-bbe77e5f7f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:41:28 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556" returned: 0 in 0.649s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-132f9394-b908-4b6e-95ba-33d985b9ecec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed7f2f4-4b28-49f1-9b92-c8e5abe12b40]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37a7d52-ea9b-47bf-bddc-bbe77e5f7f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5345aea-b50b-4b69-b263-eb9be6563995', 'volume_name': 'volume-e5345aea-b50b-4b69-b263-eb9be6563995', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3705ee-e1f4-4137-94af-92e6622a792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3705ee-e1f4-4137-94af-92e6622a792f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c882d6-fdef-46bb-85c8-b23fc6d105c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:28 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Volume e5345aea-b50b-4b69-b263-eb9be6563995: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5345aea-b50b-4b69-b263-eb9be6563995', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Trying to clone e5345aea-b50b-4b69-b263-eb9be6563995 from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b at location (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:41:28 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec Sep 30 19:41:28 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Acquiring lock "cinder-d4fd49e1-644f-4e59-9242-5a7f44698019-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Lock "cinder-d4fd49e1-644f-4e59-9242-5a7f44698019-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:29 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:41:29 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Image download 20.69 MB at 20.69 MB/s Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec" returned: 0 in 0.637s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:29 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 Sep 30 19:41:29 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b918985-e573-4913-a0ef-db51a35dbbc5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Acquiring lock "cinder-quobyte-d4fd49e1-644f-4e59-9242-5a7f44698019" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Lock "cinder-quobyte-d4fd49e1-644f-4e59-9242-5a7f44698019" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8f1c79-9053-4d58-adf6-31f8ab1feaca]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:29 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD Sep 30 19:41:29 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:29 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019 Sep 30 19:41:29 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:29 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556" returned: 0 in 0.425s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:29 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556 Sep 30 19:41:29 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:29 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b is fetched for user eed1e502105a487f97a2258cff74189b. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa2d0b4-2ae7-4a7d-b051-1c2e4a83a9a8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:29 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019" returned: 0 in 0.486s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:29 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019 Sep 30 19:41:29 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:29 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD Sep 30 19:41:29 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:29 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec.a4a6eafb-0c37-4f98-b448-b3573bd97556" returned: 0 in 0.379s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-quobyte-a4a6eafb-0c37-4f98-b448-b3573bd97556" released by "_delete_snapshot" :: held 2.323s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-quobyte-132f9394-b908-4b6e-95ba-33d985b9ecec" released by "delete_snapshot" :: held 2.360s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:30 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4fd49e1-644f-4e59-9242-5a7f44698019" returned: 0 in 0.339s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Lock "cinder-quobyte-d4fd49e1-644f-4e59-9242-5a7f44698019" released by "delete_volume" :: held 0.890s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Created reservations ['dc79085d-68d9-4a37-aff7-9f56391f6a07', 'ca519e2d-893a-40c3-9816-8b29bf5f7c0d', 'f9e46e80-5853-47b4-a8b9-b173807aa0b2', 'bb8371cf-b6fb-4a32-8c96-fd627e9645cd'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Created reservations ['b7966e8f-6ac1-4e9c-b3cc-7c78fe3198c9', 'af917c35-45a6-4265-9f5f-31edefba1164', '0c5fc3e1-3c51-4125-a64e-f83a68d27e01', '0c96ac43-c0b7-4adf-9cac-4a2fed111073'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:30 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-328551384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5345aea-b50b-4b69-b263-eb9be6563995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae11484bc234133bd05d8dc4f3f4d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:28Z,use_quota=True,user_id='eed1e502105a487f97a2258cff74189b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Creating volume e5345aea-b50b-4b69-b263-eb9be6563995 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:30 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:30 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 1073741824 Sep 30 19:41:30 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Delete snapshot completed successfully. Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6a1fdff-aecd-40a5-ac33-16dd8d10a045 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-a4a6eafb-0c37-4f98-b448-b3573bd97556-delete_snapshot" released by "delete_snapshot" :: held 2.653s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:30 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:30 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:30 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.427s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Deleted volume successfully. Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20737ec7-9e25-4b0b-be2c-e2278ae4f80f tempest-VolumesTransfersTest-1289197287 None] Lock "cinder-d4fd49e1-644f-4e59-9242-5a7f44698019-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:30 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 1073741824" returned: 0 in 0.691s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:30 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 Sep 30 19:41:30 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Acquiring lock "cinder-132f9394-b908-4b6e-95ba-33d985b9ecec-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-132f9394-b908-4b6e-95ba-33d985b9ecec-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Acquiring lock "cinder-quobyte-132f9394-b908-4b6e-95ba-33d985b9ecec" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-quobyte-132f9394-b908-4b6e-95ba-33d985b9ecec" acquired by "delete_volume" :: waited 0.055s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[495a4d95-027f-45b4-a80f-8e704e645823]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:31 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995" returned: 0 in 0.500s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Attempting download of 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume e5345aea-b50b-4b69-b263-eb9be6563995. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:41:31 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec Sep 30 19:41:31 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb40df6-ca53-458b-94cc-bca4ce22ed85]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_i6a30g58 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:31 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_i6a30g58 Sep 30 19:41:31 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:32 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec" returned: 0 in 0.677s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:32 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec Sep 30 19:41:32 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:32 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_i6a30g58" returned: 0 in 0.524s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_i6a30g58 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:32 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_i6a30g58 Sep 30 19:41:32 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:32 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-132f9394-b908-4b6e-95ba-33d985b9ecec" returned: 0 in 0.392s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-quobyte-132f9394-b908-4b6e-95ba-33d985b9ecec" released by "delete_volume" :: held 1.214s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Created reservations ['6fe51b6e-5da4-44dc-95c2-50bc5a821755', '56f4d1d1-f05b-4e67-ae2e-ab9bce4a9569', '3044f83d-f283-4d0c-ab7f-cd680387da0d', '83f794d9-7302-475e-8f6b-b2190ae7e4f3'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:32 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_i6a30g58" returned: 1 in 0.485s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_i6a30g58' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98a8fe-9edb-4782-a893-c60f679dea10]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:32 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:32 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:32 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD Sep 30 19:41:32 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:32 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.361s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:32 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:33 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Deleted volume successfully. Sep 30 19:41:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90f4be13-8223-400c-b114-7ef22ed719f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1823204727 None] Lock "cinder-132f9394-b908-4b6e-95ba-33d985b9ecec-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:33 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:33 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] 5be8283e-b86b-4bc8-8baa-e16813f20b2b was qcow2, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:41:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:33 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 Sep 30 19:41:33 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:36 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995" returned: 0 in 3.101s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:36 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b__zqqa74ldevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:41:36 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Converted 112.00 MB image at 36.10 MB/s Sep 30 19:41:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:36 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 1G Sep 30 19:41:36 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:36 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 1G" returned: 0 in 0.634s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:36 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Downloaded image 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume e5345aea-b50b-4b69-b263-eb9be6563995 successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:41:36 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b for user eed1e502105a487f97a2258cff74189b is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:41:36 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Marking volume e5345aea-b50b-4b69-b263-eb9be6563995 as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:41:36 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Copying metadata from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b to e5345aea-b50b-4b69-b263-eb9be6563995. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:41:36 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Creating volume glance metadata for volume e5345aea-b50b-4b69-b263-eb9be6563995 backed by image 5be8283e-b86b-4bc8-8baa-e16813f20b2b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:41:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c882d6-fdef-46bb-85c8-b23fc6d105c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5345aea-b50b-4b69-b263-eb9be6563995', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c86036-d891-4f41-93b4-6b8d732a3bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:37 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Volume volume-e5345aea-b50b-4b69-b263-eb9be6563995 (e5345aea-b50b-4b69-b263-eb9be6563995): created successfully Sep 30 19:41:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c86036-d891-4f41-93b4-6b8d732a3bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Flow 'volume_create_manager' (5036589a-df30-4013-883e-3d92a98e8ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:37 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2de78afe-9b56-444e-8851-e75cd4a66ee0 tempest-VolumesImageMetadata-770408501 None] Created volume successfully. Sep 30 19:41:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Acquiring lock "cinder-e5345aea-b50b-4b69-b263-eb9be6563995-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Lock "cinder-e5345aea-b50b-4b69-b263-eb9be6563995-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Acquiring lock "cinder-quobyte-e5345aea-b50b-4b69-b263-eb9be6563995" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Lock "cinder-quobyte-e5345aea-b50b-4b69-b263-eb9be6563995" acquired by "delete_volume" :: waited 0.039s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:39 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2ecd26-b37e-4e87-9666-07bf274bd4d7]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:39 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 Sep 30 19:41:39 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:40 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995" returned: 0 in 0.580s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:40 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995 Sep 30 19:41:40 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:40 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5345aea-b50b-4b69-b263-eb9be6563995" returned: 0 in 0.672s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Lock "cinder-quobyte-e5345aea-b50b-4b69-b263-eb9be6563995" released by "delete_volume" :: held 1.368s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:40 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Created reservations ['edaf535e-0007-4e3f-9875-42709fae1990', '2c594d89-0561-4776-a00f-bee334e40e0b', '8b8d741d-bfa7-401b-8e2a-8b83a27713c3', '9bd0afb5-7280-4d21-a2db-4849f79bef57'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:41 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:41 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:41 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.517s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:41 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:41 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Deleted volume successfully. Sep 30 19:41:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0eec7413-310c-447d-aec0-205f465aa5d9 tempest-VolumesImageMetadata-770408501 None] Lock "cinder-e5345aea-b50b-4b69-b263-eb9be6563995-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=65,cinder:INSERT=24,cinder:UPDATE=82,cinder:DELETE=7 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=95,cinder:SELECT=72,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Flow 'volume_create_manager' (077e0d0c-1069-4799-870e-41624e5c3041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51996ac-d8b2-495b-a40e-576bfc92de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51996ac-d8b2-495b-a40e-576bfc92de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-442949051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1747038-5eb6-48dc-9489-2fefe11eff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce486fb95d54419ad95a3711fdcd673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:52Z,use_quota=True,user_id='92448a329bda48da979385b642fe32d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f817c886-c85a-49f9-bf0a-305e3f3a8253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f817c886-c85a-49f9-bf0a-305e3f3a8253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bd72a5-a60e-4c27-8d7f-2e3d9826a251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bd72a5-a60e-4c27-8d7f-2e3d9826a251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1747038-5eb6-48dc-9489-2fefe11eff66', 'volume_name': 'volume-c1747038-5eb6-48dc-9489-2fefe11eff66', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002c1c11-3ad4-4a10-a209-345e5cd32a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002c1c11-3ad4-4a10-a209-345e5cd32a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031cdb61-a9e7-4232-9918-c9f00a92ff93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:51 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Volume c1747038-5eb6-48dc-9489-2fefe11eff66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1747038-5eb6-48dc-9489-2fefe11eff66', 'volume_size': 1} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-442949051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1747038-5eb6-48dc-9489-2fefe11eff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce486fb95d54419ad95a3711fdcd673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:52Z,use_quota=True,user_id='92448a329bda48da979385b642fe32d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Creating volume c1747038-5eb6-48dc-9489-2fefe11eff66 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:51 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:51 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66 1073741824 Sep 30 19:41:51 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:52 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Flow 'volume_create_manager' (eb172c11-97a6-4ab3-ae2b-0204e3d58c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b8c8e6-ec89-4e5e-9177-f40be8560b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66 1073741824" returned: 0 in 0.645s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b8c8e6-ec89-4e5e-9177-f40be8560b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-930891235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b634a5-ad59-4b96-b346-2e806c3d6633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e131f8c93b54da184e6bb9e6d0bc19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:52Z,use_quota=True,user_id='f0890d58ca1b4e48be671d09aa022b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f6758e-5f71-4201-b713-62e19af239ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f6758e-5f71-4201-b713-62e19af239ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b16b21-15f4-4eb2-89b1-eb4ad24c9482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b16b21-15f4-4eb2-89b1-eb4ad24c9482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b634a5-ad59-4b96-b346-2e806c3d6633', 'volume_name': 'volume-72b634a5-ad59-4b96-b346-2e806c3d6633', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ff0d28-01db-450f-ba3c-050d34545796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ff0d28-01db-450f-ba3c-050d34545796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc38767e-44c2-4991-a5e0-8ac905ee3147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:52 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Volume 72b634a5-ad59-4b96-b346-2e806c3d6633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b634a5-ad59-4b96-b346-2e806c3d6633', 'volume_size': 1} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:52 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66 Sep 30 19:41:52 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:52 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66" returned: 0 in 0.345s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-930891235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b634a5-ad59-4b96-b346-2e806c3d6633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e131f8c93b54da184e6bb9e6d0bc19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:52Z,use_quota=True,user_id='f0890d58ca1b4e48be671d09aa022b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Creating volume 72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:53 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:53 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 1073741824 Sep 30 19:41:53 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031cdb61-a9e7-4232-9918-c9f00a92ff93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1747038-5eb6-48dc-9489-2fefe11eff66', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a962b6b8-7140-4e50-b481-c120f4f41298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Volume volume-c1747038-5eb6-48dc-9489-2fefe11eff66 (c1747038-5eb6-48dc-9489-2fefe11eff66): created successfully Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a962b6b8-7140-4e50-b481-c120f4f41298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Flow 'volume_create_manager' (077e0d0c-1069-4799-870e-41624e5c3041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-85c34899-1678-456a-847d-e47bb90254e2 tempest-AbsoluteLimitsTests-330491463 None] Created volume successfully. Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Flow 'volume_create_manager' (9156ea91-8f9c-444c-8d1f-5510a4757637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de024d1f-57b5-4f30-b076-ad4d96f56bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de024d1f-57b5-4f30-b076-ad4d96f56bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1223791549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcf6d3c-1b78-4a7b-9498-112b73153427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51619e6b6fe4f9399729adcd4b03f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:53Z,use_quota=True,user_id='08481fdf764c4406b8e712a40501d394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70e5d74-6881-453e-b261-4de5c69e7ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70e5d74-6881-453e-b261-4de5c69e7ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e535064-434f-46ba-9ab0-1992f3fc4098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e535064-434f-46ba-9ab0-1992f3fc4098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dcf6d3c-1b78-4a7b-9498-112b73153427', 'volume_name': 'volume-1dcf6d3c-1b78-4a7b-9498-112b73153427', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440332a8-8a46-4f7b-b785-e5c207c8f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440332a8-8a46-4f7b-b785-e5c207c8f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e64090e-f723-4133-b021-4a96b367c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Volume 1dcf6d3c-1b78-4a7b-9498-112b73153427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dcf6d3c-1b78-4a7b-9498-112b73153427', 'volume_size': 1} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:53 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 1073741824" returned: 0 in 0.641s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:53 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 Sep 30 19:41:53 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:53 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633" returned: 0 in 0.282s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1223791549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcf6d3c-1b78-4a7b-9498-112b73153427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51619e6b6fe4f9399729adcd4b03f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:53Z,use_quota=True,user_id='08481fdf764c4406b8e712a40501d394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Creating volume 1dcf6d3c-1b78-4a7b-9498-112b73153427 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:53 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc38767e-44c2-4991-a5e0-8ac905ee3147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b634a5-ad59-4b96-b346-2e806c3d6633', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:54 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 1073741824 Sep 30 19:41:54 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e601c93d-c31c-4bb8-94fd-813e09d70700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:54 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Volume volume-72b634a5-ad59-4b96-b346-2e806c3d6633 (72b634a5-ad59-4b96-b346-2e806c3d6633): created successfully Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e601c93d-c31c-4bb8-94fd-813e09d70700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Flow 'volume_create_manager' (eb172c11-97a6-4ab3-ae2b-0204e3d58c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:54 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6749acaf-2f59-41f0-bf3b-a2b0f70daf41 tempest-VolumesSnapshotListTestJSON-521298953 None] Created volume successfully. Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Acquiring lock "cinder-c1747038-5eb6-48dc-9489-2fefe11eff66-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Lock "cinder-c1747038-5eb6-48dc-9489-2fefe11eff66-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Acquiring lock "cinder-quobyte-c1747038-5eb6-48dc-9489-2fefe11eff66" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Lock "cinder-quobyte-c1747038-5eb6-48dc-9489-2fefe11eff66" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[85135aa0-bd52-4c8f-8ef9-5bd9bff78aef]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:54 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 1073741824" returned: 0 in 0.702s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:54 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66 Sep 30 19:41:54 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:54 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 Sep 30 19:41:54 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:55 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427" returned: 0 in 0.318s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.178s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e64090e-f723-4133-b021-4a96b367c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dcf6d3c-1b78-4a7b-9498-112b73153427', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8e3682-1e37-4dcf-815a-3019d453659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Creating offline snapshot 779ed238-b208-47a6-8415-97e2e1039153 of volume 72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:41:55 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Volume volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 (1dcf6d3c-1b78-4a7b-9498-112b73153427): created successfully Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8e3682-1e37-4dcf-815a-3019d453659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Flow 'volume_create_manager' (9156ea91-8f9c-444c-8d1f-5510a4757637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6ad61-7120-4e17-9bbf-ae7ecaee7df9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:55 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66" returned: 0 in 0.630s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e22c8fc6-41b2-4f14-8fb6-eff6b9b77099 tempest-ServersNegativeTestJSON-419337535 None] Created volume successfully. Sep 30 19:41:55 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66 Sep 30 19:41:55 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:55 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 Sep 30 19:41:55 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:55 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c1747038-5eb6-48dc-9489-2fefe11eff66" returned: 0 in 0.406s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Lock "cinder-quobyte-c1747038-5eb6-48dc-9489-2fefe11eff66" released by "delete_volume" :: held 1.109s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Created reservations ['372842f9-066b-44f2-b00d-3973c0c8290b', 'dc75772f-c986-45b6-9c06-c77324372617', '15473b5c-11f2-4257-8d58-69cd72ce87cf', '6931b9b2-2a4b-4c65-8d95-f296683176bd'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:41:55 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633" returned: 0 in 0.615s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:55 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 1G Sep 30 19:41:55 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:55 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:41:55 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:56 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.306s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:56 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:41:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Deleted volume successfully. Sep 30 19:41:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ee37a469-b47a-4a20-aa9c-3203b4e7ca8a tempest-AbsoluteLimitsTests-330491463 None] Lock "cinder-c1747038-5eb6-48dc-9489-2fefe11eff66-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:41:56 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 1G" returned: 0 in 0.542s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b634a5-ad59-4b96-b346-2e806c3d6633 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:56 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b634a5-ad59-4b96-b346-2e806c3d6633 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 Sep 30 19:41:56 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:56 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b634a5-ad59-4b96-b346-2e806c3d6633 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153" returned: 0 in 0.341s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:56 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 is being set with open permissions: ugo+rw Sep 30 19:41:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:56 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 Sep 30 19:41:56 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:56 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:56 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.info Sep 30 19:41:56 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Flow 'volume_create_manager' (88109c84-169f-4435-8431-4f2e870d4a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc21e0a3-24da-4955-8f3d-1bf10185e16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc21e0a3-24da-4955-8f3d-1bf10185e16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2044127961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353f9cdf-6a0a-4486-8c6e-48f14fc2239d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51619e6b6fe4f9399729adcd4b03f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:57Z,use_quota=True,user_id='08481fdf764c4406b8e712a40501d394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6644e924-3abe-41ae-b3e3-f0ab4169f070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6644e924-3abe-41ae-b3e3-f0ab4169f070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ef80e0-b67c-43fb-9766-272107fdb07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ef80e0-b67c-43fb-9766-272107fdb07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353f9cdf-6a0a-4486-8c6e-48f14fc2239d', 'volume_name': 'volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e045a00-c17f-4c56-a031-9a24ea9dacc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e045a00-c17f-4c56-a031-9a24ea9dacc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e185546-ab79-4e20-bbc5-df258157d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Volume 353f9cdf-6a0a-4486-8c6e-48f14fc2239d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d', 'volume_size': 1} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:57 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.info" returned: 0 in 0.320s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:57 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.info is being set with open permissions: ugo+rw Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:57 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.info Sep 30 19:41:57 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:57 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.info" returned: 0 in 0.293s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2044127961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353f9cdf-6a0a-4486-8c6e-48f14fc2239d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51619e6b6fe4f9399729adcd4b03f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:41:57Z,use_quota=True,user_id='08481fdf764c4406b8e712a40501d394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Creating volume 353f9cdf-6a0a-4486-8c6e-48f14fc2239d {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:41:57 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:41:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:57 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d 1073741824 Sep 30 19:41:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e94aa26a-0061-4277-b86c-365fb7c9aba3 tempest-VolumesSnapshotListTestJSON-521298953 None] Create snapshot completed successfully Sep 30 19:41:57 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:58 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d 1073741824" returned: 0 in 0.613s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:58 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d Sep 30 19:41:58 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:41:58 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d" returned: 0 in 0.326s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.243s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Creating offline snapshot f12b6da6-c0fd-45ff-bcc8-357905bb9847 of volume 72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e185546-ab79-4e20-bbc5-df258157d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bed4517-bef3-4e86-94e7-060cb85fe458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20470d7-4613-4f30-82b4-106641c82df7]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:58 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Volume volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d (353f9cdf-6a0a-4486-8c6e-48f14fc2239d): created successfully Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bed4517-bef3-4e86-94e7-060cb85fe458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:41:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Flow 'volume_create_manager' (88109c84-169f-4435-8431-4f2e870d4a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:41:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a9a837a7-54dd-48fb-97cd-f12a6dc79735 tempest-ServersNegativeTestJSON-419337535 None] Created volume successfully. Sep 30 19:41:58 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 Sep 30 19:41:58 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:59 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153" returned: 0 in 0.600s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b634a5-ad59-4b96-b346-2e806c3d6633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:41:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:59 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 1G Sep 30 19:41:59 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:41:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "cinder-353f9cdf-6a0a-4486-8c6e-48f14fc2239d-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Lock "cinder-353f9cdf-6a0a-4486-8c6e-48f14fc2239d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:41:59 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Sep 30 19:41:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 1G" returned: 0 in 0.637s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:41:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:41:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "cinder-quobyte-353f9cdf-6a0a-4486-8c6e-48f14fc2239d" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:41:59 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 Sep 30 19:41:59 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Lock "cinder-quobyte-353f9cdf-6a0a-4486-8c6e-48f14fc2239d" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[699e37bf-b16e-4abc-92b6-78a53f938e72]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:00 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d Sep 30 19:42:00 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:00 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847" returned: 0 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:00 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 is being set with open permissions: ugo+rw Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:00 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 Sep 30 19:42:00 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:00 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d" returned: 0 in 0.511s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:00 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d Sep 30 19:42:00 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:00 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847" returned: 0 in 0.394s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8e35b70f-69e2-4110-a408-2bf79ec9454f tempest-VolumesSnapshotListTestJSON-521298953 None] Create snapshot completed successfully Sep 30 19:42:00 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-353f9cdf-6a0a-4486-8c6e-48f14fc2239d" returned: 0 in 0.313s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Lock "cinder-quobyte-353f9cdf-6a0a-4486-8c6e-48f14fc2239d" released by "delete_volume" :: held 0.878s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Created reservations ['1da255d4-f144-431c-abad-b0bcfd24a8f3', '65a632e0-ab5b-450b-8203-8c50aa7ea00c', 'a588e3e5-2c0f-45b6-bc1d-0965c6a379c0', '1bf5e596-bf3b-4976-939f-4e01a480368f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:01 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:42:01 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:01 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.270s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:42:01 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Deleted volume successfully. Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-af58cbe7-8573-4248-b64b-de6b0569d738 tempest-ServersNegativeTestJSON-419337535 None] Lock "cinder-353f9cdf-6a0a-4486-8c6e-48f14fc2239d-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Creating offline snapshot ed9dd793-2ba5-4580-923f-969672e9a106 of volume 72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a62ac8-9e43-4cca-97fc-4682de08e585]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:01 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 Sep 30 19:42:01 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "cinder-1dcf6d3c-1b78-4a7b-9498-112b73153427-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Lock "cinder-1dcf6d3c-1b78-4a7b-9498-112b73153427-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "cinder-quobyte-1dcf6d3c-1b78-4a7b-9498-112b73153427" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Lock "cinder-quobyte-1dcf6d3c-1b78-4a7b-9498-112b73153427" acquired by "delete_volume" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f788a03-314e-4936-8ed7-1cc3cd463a64]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:02 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847" returned: 0 in 0.489s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b634a5-ad59-4b96-b346-2e806c3d6633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:02 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 1G Sep 30 19:42:02 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:02 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 Sep 30 19:42:02 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:02 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427" returned: 0 in 0.506s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:02 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427 Sep 30 19:42:02 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:02 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 1G" returned: 0 in 0.633s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:02 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 Sep 30 19:42:02 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:03 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1dcf6d3c-1b78-4a7b-9498-112b73153427" returned: 0 in 0.286s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Lock "cinder-quobyte-1dcf6d3c-1b78-4a7b-9498-112b73153427" released by "delete_volume" :: held 0.842s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Created reservations ['3c69f5fd-6015-4212-8de5-540b3b882e7e', 'd83b3cd7-52db-47fe-bd49-645378f37013', '93750069-66ab-487f-aa10-2d0024f47d35', 'bb97eb57-7f3d-4f5a-b1c3-97c1bae833a7'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:03 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:42:03 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:03 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106" returned: 0 in 0.442s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:03 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 is being set with open permissions: ugo+rw Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:03 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 Sep 30 19:42:03 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:03 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.304s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:42:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Deleted volume successfully. Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-da306947-c6f3-4a67-9e0c-1f43c72d4748 tempest-ServersNegativeTestJSON-419337535 None] Lock "cinder-1dcf6d3c-1b78-4a7b-9498-112b73153427-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:03 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106" returned: 0 in 0.364s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-bc40437d-65b1-4ccc-97b3-5e8c96a86758 tempest-VolumesSnapshotListTestJSON-521298953 None] Create snapshot completed successfully Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Flow 'volume_create_manager' (81f45f01-cad9-4e5f-ba42-3a7032913a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8682d90-79ae-4b85-969e-c2f9a2514df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8682d90-79ae-4b85-969e-c2f9a2514df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1152257760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ed041c-2acd-4da3-9ff3-ed5668d780f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43656a72ae5449428a9ce0b181ffe9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:42:06Z,use_quota=True,user_id='914d9afd9c8d44f9a95a345abea2363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b102ddb3-ce1e-4233-b96f-8eab54740ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b102ddb3-ce1e-4233-b96f-8eab54740ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef0240b-e245-4cf4-803a-1735136eaaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef0240b-e245-4cf4-803a-1735136eaaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ed041c-2acd-4da3-9ff3-ed5668d780f8', 'volume_name': 'volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d147b8e0-94dc-4893-a1ea-28ee08d35723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d147b8e0-94dc-4893-a1ea-28ee08d35723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1d0f4c-509d-4361-80b4-f7bdd88486f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:05 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Volume 15ed041c-2acd-4da3-9ff3-ed5668d780f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8', 'volume_size': 1} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1152257760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ed041c-2acd-4da3-9ff3-ed5668d780f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43656a72ae5449428a9ce0b181ffe9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:42:06Z,use_quota=True,user_id='914d9afd9c8d44f9a95a345abea2363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Creating volume 15ed041c-2acd-4da3-9ff3-ed5668d780f8 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:42:06 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:06 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 1073741824 Sep 30 19:42:06 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-ed9dd793-2ba5-4580-923f-969672e9a106-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-ed9dd793-2ba5-4580-923f-969672e9a106-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-quobyte-ed9dd793-2ba5-4580-923f-969672e9a106" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-ed9dd793-2ba5-4580-923f-969672e9a106" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Deleting offline snapshot ed9dd793-2ba5-4580-923f-969672e9a106 of volume 72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] snapshot_file for this snap is: volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[271b1d78-7d17-4e15-ad36-7d24cfef1eea]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:06 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 Sep 30 19:42:06 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:06 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 1073741824" returned: 0 in 0.555s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:06 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 Sep 30 19:42:06 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:06 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106" returned: 0 in 0.565s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b634a5-ad59-4b96-b346-2e806c3d6633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e5feb2-3e90-4d23-8db9-ec098a1df9bb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:06 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8" returned: 0 in 0.377s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1d0f4c-509d-4361-80b4-f7bdd88486f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91663332-97b5-4dd3-945a-6068e351f212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:07 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 Sep 30 19:42:07 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:07 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Volume volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 (15ed041c-2acd-4da3-9ff3-ed5668d780f8): created successfully Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91663332-97b5-4dd3-945a-6068e351f212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Flow 'volume_create_manager' (81f45f01-cad9-4e5f-ba42-3a7032913a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:42:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a0f16aa0-be7b-4a48-b1d1-07d27d63940c tempest-VolumesTransfersV355Test-432956557 None] Created volume successfully. Sep 30 19:42:07 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847" returned: 0 in 0.453s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b634a5-ad59-4b96-b346-2e806c3d6633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:07 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 Sep 30 19:42:07 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:07 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106" returned: 0 in 0.544s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:07 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106 Sep 30 19:42:07 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:08 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.ed9dd793-2ba5-4580-923f-969672e9a106" returned: 0 in 0.365s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-ed9dd793-2ba5-4580-923f-969672e9a106" released by "_delete_snapshot" :: held 2.090s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" released by "delete_snapshot" :: held 2.124s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:08 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Created reservations ['c6260acd-fdd1-4387-9d89-526406f0dc21', 'bd55b403-0116-4b8b-9c98-ca63c1d7e5d4', 'c146a849-cf8d-4dfe-ad3e-3cfe0318cf23', '9e91aa6d-ed93-4bf5-bc21-8038382be0ed'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:42:08 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Delete snapshot completed successfully. Sep 30 19:42:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7c78ba4c-6f33-4f31-bdca-b21e1804c669 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-ed9dd793-2ba5-4580-923f-969672e9a106-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-54d8c6fe-d048-40d2-92a3-91e58c24f907 tempest-VolumesTransfersV355Test-103467132 None] Transfer volume completed successfully. Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-f12b6da6-c0fd-45ff-bcc8-357905bb9847-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-f12b6da6-c0fd-45ff-bcc8-357905bb9847-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-quobyte-f12b6da6-c0fd-45ff-bcc8-357905bb9847" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-f12b6da6-c0fd-45ff-bcc8-357905bb9847" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Deleting offline snapshot f12b6da6-c0fd-45ff-bcc8-357905bb9847 of volume 72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] snapshot_file for this snap is: volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a7f84-2be0-4d35-b0f6-6a51a093fe0d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:09 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 Sep 30 19:42:09 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:10 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847" returned: 0 in 0.475s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b634a5-ad59-4b96-b346-2e806c3d6633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2f37f5-7413-4f24-bbe9-c971d5de0bb6]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Acquiring lock "cinder-15ed041c-2acd-4da3-9ff3-ed5668d780f8-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Lock "cinder-15ed041c-2acd-4da3-9ff3-ed5668d780f8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Acquiring lock "cinder-quobyte-15ed041c-2acd-4da3-9ff3-ed5668d780f8" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Lock "cinder-quobyte-15ed041c-2acd-4da3-9ff3-ed5668d780f8" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:10 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 Sep 30 19:42:10 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dae4d6-c422-40d9-bb5b-b78019c24d6b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:10 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 Sep 30 19:42:10 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:10 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153" returned: 0 in 0.408s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b634a5-ad59-4b96-b346-2e806c3d6633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:10 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 Sep 30 19:42:10 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:10 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8" returned: 0 in 0.474s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:10 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8 Sep 30 19:42:10 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:11 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:11 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847" returned: 0 in 0.594s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-15ed041c-2acd-4da3-9ff3-ed5668d780f8" returned: 0 in 0.387s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:11 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847 Sep 30 19:42:11 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Lock "cinder-quobyte-15ed041c-2acd-4da3-9ff3-ed5668d780f8" released by "delete_volume" :: held 0.935s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Created reservations ['b03c199f-1601-41c6-935c-ece3e1a3b3d4', '3d32a96e-65cd-4145-b54c-af52e0dbf5c5', 'ac669c4a-55c2-4338-ad00-6568721b62c1', '30b38529-9412-47d8-8f9f-9e0c2f7a7662'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:11 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:42:11 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:11 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.f12b6da6-c0fd-45ff-bcc8-357905bb9847" returned: 0 in 0.404s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-f12b6da6-c0fd-45ff-bcc8-357905bb9847" released by "_delete_snapshot" :: held 2.036s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" released by "delete_snapshot" :: held 2.068s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Created reservations ['b8f009e8-91ec-45e4-b84a-ba34db1675eb', '24ea8776-d602-4e79-a80a-c72caa830013', '55730fa9-ea58-4643-8a03-d5f4ea5e2244', '4664a0de-0c02-475e-9861-a36a2ee3ae03'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:42:11 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.341s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:42:11 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Deleted volume successfully. Sep 30 19:42:11 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Delete snapshot completed successfully. Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8ee1ec30-0e55-4639-98cb-2fd1a658946e tempest-VolumesTransfersV355Test-1492206248 None] Lock "cinder-15ed041c-2acd-4da3-9ff3-ed5668d780f8-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6338f816-25aa-43ef-a532-09a281aee46c tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-f12b6da6-c0fd-45ff-bcc8-357905bb9847-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-779ed238-b208-47a6-8415-97e2e1039153-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-779ed238-b208-47a6-8415-97e2e1039153-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-quobyte-779ed238-b208-47a6-8415-97e2e1039153" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-779ed238-b208-47a6-8415-97e2e1039153" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Deleting offline snapshot 779ed238-b208-47a6-8415-97e2e1039153 of volume 72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] snapshot_file for this snap is: volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[43faabe5-77b9-4971-9a7c-b737a37fee56]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:13 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 Sep 30 19:42:13 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Flow 'volume_create_manager' (18db2df4-ec54-4719-8e2b-d94ce5f02a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fefef74-2e47-4d27-ba80-93f72e57ba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fefef74-2e47-4d27-ba80-93f72e57ba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1510806437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75bf3e4-fc49-4983-af3d-4b40868ce588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43656a72ae5449428a9ce0b181ffe9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:42:13Z,use_quota=True,user_id='914d9afd9c8d44f9a95a345abea2363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563cc7a2-992d-4871-85ed-9785ee52b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563cc7a2-992d-4871-85ed-9785ee52b68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cb0095-c345-4dd3-bc58-1400ff51e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cb0095-c345-4dd3-bc58-1400ff51e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75bf3e4-fc49-4983-af3d-4b40868ce588', 'volume_name': 'volume-e75bf3e4-fc49-4983-af3d-4b40868ce588', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fae1886-502c-49f5-aa98-4c62a755db3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fae1886-502c-49f5-aa98-4c62a755db3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b449c663-4226-4280-98e6-17224f31a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:13 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Volume e75bf3e4-fc49-4983-af3d-4b40868ce588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75bf3e4-fc49-4983-af3d-4b40868ce588', 'volume_size': 1} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1510806437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75bf3e4-fc49-4983-af3d-4b40868ce588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43656a72ae5449428a9ce0b181ffe9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:42:13Z,use_quota=True,user_id='914d9afd9c8d44f9a95a345abea2363f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Creating volume e75bf3e4-fc49-4983-af3d-4b40868ce588 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:42:13 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:13 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 1073741824 Sep 30 19:42:13 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:13 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153" returned: 0 in 0.578s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b634a5-ad59-4b96-b346-2e806c3d6633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea009ab-a506-4d55-b2ab-7ed5f1cfef65]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:13 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 Sep 30 19:42:13 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:13 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 1073741824" returned: 0 in 0.594s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:13 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:13 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633" returned: 0 in 0.472s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:13 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:13 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 Sep 30 19:42:13 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:14 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588" returned: 0 in 0.303s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b449c663-4226-4280-98e6-17224f31a566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75bf3e4-fc49-4983-af3d-4b40868ce588', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705f6160-bf15-46f8-b485-c3835d3d515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:14 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Volume volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 (e75bf3e4-fc49-4983-af3d-4b40868ce588): created successfully Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705f6160-bf15-46f8-b485-c3835d3d515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Flow 'volume_create_manager' (18db2df4-ec54-4719-8e2b-d94ce5f02a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:42:14 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-753b91ec-7abf-43a7-bf31-5ffebe9224df tempest-VolumesTransfersV355Test-432956557 None] Created volume successfully. Sep 30 19:42:14 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153" returned: 0 in 0.470s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:14 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153 Sep 30 19:42:14 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:14 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633.779ed238-b208-47a6-8415-97e2e1039153" returned: 0 in 0.284s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-779ed238-b208-47a6-8415-97e2e1039153" released by "_delete_snapshot" :: held 1.974s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" released by "delete_snapshot" :: held 2.006s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Created reservations ['f989e10c-ff88-4a78-9a2b-8163b74cc89e', '6495a416-38b8-4a91-97ed-eff576847d0d', 'd265a5cf-8b70-49bd-8a8d-daf505b97547', '9c03df84-4c2f-4925-99e1-032fadc6672c'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:42:14 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Delete snapshot completed successfully. Sep 30 19:42:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b8e96084-4e1d-4467-beb9-c22d17775ac6 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-779ed238-b208-47a6-8415-97e2e1039153-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Acquiring lock "cinder-e75bf3e4-fc49-4983-af3d-4b40868ce588-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Lock "cinder-e75bf3e4-fc49-4983-af3d-4b40868ce588-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Acquiring lock "cinder-quobyte-e75bf3e4-fc49-4983-af3d-4b40868ce588" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Lock "cinder-quobyte-e75bf3e4-fc49-4983-af3d-4b40868ce588" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:15 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9f7425-bb07-449e-b000-5ecb98c01437]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:15 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 Sep 30 19:42:15 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-72b634a5-ad59-4b96-b346-2e806c3d6633-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-72b634a5-ad59-4b96-b346-2e806c3d6633-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:16 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588" returned: 0 in 0.589s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d002d991-80c0-4977-881b-4390969bcf54]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:16 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588 Sep 30 19:42:16 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:16 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 Sep 30 19:42:16 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:16 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e75bf3e4-fc49-4983-af3d-4b40868ce588" returned: 0 in 0.454s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Lock "cinder-quobyte-e75bf3e4-fc49-4983-af3d-4b40868ce588" released by "delete_volume" :: held 1.097s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Created reservations ['69fa6e2e-7a54-4121-9ecf-70b435dfb31c', '6c1a132b-117c-4499-997e-8d0476593945', '4b278c0b-d79b-4a15-93f2-cca71719b15e', '6d4c08a3-781c-46af-b6f7-dcde2b3955cf'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:42:16 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633" returned: 0 in 0.613s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:16 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633 Sep 30 19:42:16 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:16 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:42:16 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:17 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-72b634a5-ad59-4b96-b346-2e806c3d6633" returned: 0 in 0.399s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-quobyte-72b634a5-ad59-4b96-b346-2e806c3d6633" released by "delete_volume" :: held 1.112s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:17 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.402s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:42:17 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Deleted volume successfully. Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d323b036-9738-441e-b2ba-9fd5ff47b26e tempest-VolumesTransfersV355Test-1492206248 None] Lock "cinder-e75bf3e4-fc49-4983-af3d-4b40868ce588-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Created reservations ['7ccbd72f-92cc-4f5f-860a-33252c215cf3', '129aff5c-1395-4b8a-90e2-66058667a848', '72434145-8e73-4e32-9ba8-6778257ba5f6', '4100bc0e-1505-420c-bdb5-4c5286c4958e'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:17 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:42:17 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:17 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.290s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:42:17 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Deleted volume successfully. Sep 30 19:42:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-99e965e3-04d3-4c4a-b5c6-5967dbb83ff2 tempest-VolumesSnapshotListTestJSON-521298953 None] Lock "cinder-72b634a5-ad59-4b96-b346-2e806c3d6633-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:42:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:23 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:42:23 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:24 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.375s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:42:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:42:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:42:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:42:27 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=91,cinder:SELECT=65,cinder:INSERT=21,cinder:DELETE=2 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:42:27 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=73,cinder:UPDATE=88,cinder:INSERT=22,cinder:DELETE=13 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Flow 'volume_create_manager' (b533c2d7-8fa9-4f3e-8a34-12f23dae148b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e82f21b-68fe-4421-b71c-e642818db56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e82f21b-68fe-4421-b71c-e642818db56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-502865890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b8bc0b-e36b-4277-87da-bf857b8523c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4364527e8c9541bb950abdb31750d2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:42:39Z,use_quota=True,user_id='f3d6c5a9eb6c422c81f558d7e19545fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcc39bc-18f8-48ac-8017-9674f7714a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcc39bc-18f8-48ac-8017-9674f7714a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23652e5-5554-4ac1-a72c-0bb69b119510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23652e5-5554-4ac1-a72c-0bb69b119510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b8bc0b-e36b-4277-87da-bf857b8523c7', 'volume_name': 'volume-27b8bc0b-e36b-4277-87da-bf857b8523c7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f64cb2-7e3f-4976-be96-3c57c4b5d554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f64cb2-7e3f-4976-be96-3c57c4b5d554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0125755-1e4d-4067-af9f-9e804bb60582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:39 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Volume 27b8bc0b-e36b-4277-87da-bf857b8523c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b8bc0b-e36b-4277-87da-bf857b8523c7', 'volume_size': 1} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-502865890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b8bc0b-e36b-4277-87da-bf857b8523c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4364527e8c9541bb950abdb31750d2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:42:39Z,use_quota=True,user_id='f3d6c5a9eb6c422c81f558d7e19545fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Creating volume 27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:42:39 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:39 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 1073741824 Sep 30 19:42:39 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:39 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 1073741824" returned: 0 in 0.570s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:40 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 Sep 30 19:42:40 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:40 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7" returned: 0 in 0.296s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:42:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0125755-1e4d-4067-af9f-9e804bb60582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b8bc0b-e36b-4277-87da-bf857b8523c7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9244ee1a-1c3b-49f8-a9af-7308611e939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:40 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Volume volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 (27b8bc0b-e36b-4277-87da-bf857b8523c7): created successfully Sep 30 19:42:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9244ee1a-1c3b-49f8-a9af-7308611e939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Flow 'volume_create_manager' (b533c2d7-8fa9-4f3e-8a34-12f23dae148b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:42:40 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-664f9a11-66b8-4c5a-8057-0bf4cb7211a4 tempest-VolumesCloneTest-1925026210 None] Created volume successfully. Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Flow 'volume_create_manager' (bf309912-a335-4871-97b7-f595f1f0ff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa81ff4d-d695-4a1f-8c96-f96c0cd0bef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa81ff4d-d695-4a1f-8c96-f96c0cd0bef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-640677900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819ac7cf-2fcf-4b85-81d5-3cbbec85e96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4364527e8c9541bb950abdb31750d2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:42:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=27b8bc0b-e36b-4277-87da-bf857b8523c7,status='creating',terminated_at=None,updated_at=2026-09-30T17:42:42Z,use_quota=True,user_id='f3d6c5a9eb6c422c81f558d7e19545fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2c5dbf-710a-4eda-9376-ce2a256aac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2c5dbf-710a-4eda-9376-ce2a256aac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7c0816-9b6a-4661-94a3-563ef1c2fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7c0816-9b6a-4661-94a3-563ef1c2fbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '819ac7cf-2fcf-4b85-81d5-3cbbec85e96b', 'volume_name': 'volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b', 'volume_size': 2, 'source_volid': '27b8bc0b-e36b-4277-87da-bf857b8523c7', 'source_volstatus': 'available'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7344932d-8f49-41b1-b10d-4789624f71a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7344932d-8f49-41b1-b10d-4789624f71a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a628f57-58e3-42c6-b075-b1f33348268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:42:42 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Volume 819ac7cf-2fcf-4b85-81d5-3cbbec85e96b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b', 'volume_size': 2, 'source_volid': '27b8bc0b-e36b-4277-87da-bf857b8523c7', 'source_volstatus': 'available'} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:42 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Cloning volume 27b8bc0b-e36b-4277-87da-bf857b8523c7 to volume 819ac7cf-2fcf-4b85-81d5-3cbbec85e96b Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Creating offline snapshot 6f4949db-6eb8-4c38-94d2-cee044c09ad8 of volume 27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3055b632-599d-4637-b96b-ed4eed448472]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:42 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 Sep 30 19:42:42 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:43 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7" returned: 0 in 0.628s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:43 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 1G Sep 30 19:42:43 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:44 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 1G" returned: 0 in 0.912s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:44 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 Sep 30 19:42:44 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:44 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8" returned: 0 in 0.606s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:44 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 is being set with open permissions: ugo+rw Sep 30 19:42:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:44 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 Sep 30 19:42:44 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:45 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8" returned: 0 in 0.316s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:45 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.info Sep 30 19:42:45 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:45 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.info" returned: 0 in 0.405s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:45 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.info is being set with open permissions: ugo+rw Sep 30 19:42:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:45 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.info Sep 30 19:42:45 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:46 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.info" returned: 0 in 0.316s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Acquiring lock "cinder-quobyte-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Lock "cinder-quobyte-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] snapshot: 6f4949db-6eb8-4c38-94d2-cee044c09ad8, volume: 819ac7cf-2fcf-4b85-81d5-3cbbec85e96b, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc5e270-d5ba-4968-86b0-31a84e4508b5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:46 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 Sep 30 19:42:46 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:46 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8" returned: 0 in 0.410s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b8bc0b-e36b-4277-87da-bf857b8523c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a76c318-eff7-447e-b83c-a3a637a10c8b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:46 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 Sep 30 19:42:46 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:47 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7" returned: 0 in 0.457s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:42:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:42:47 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:42:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:47 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b Sep 30 19:42:47 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:55 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:DELETE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:42:55 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:42:58 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" returned: 0 in 11.897s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:58 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7, size 1024.00 MB, duration 11.90 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:42:58 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Converted 1024.00 MB image at 86.06 MB/s Sep 30 19:42:58 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b is being set with open permissions: ugo+rw Sep 30 19:42:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:58 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b Sep 30 19:42:58 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:42:59 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 30 19:42:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" returned: 0 in 0.301s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:42:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Lock "cinder-quobyte-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" released by "_copy_volume_from_snapshot" :: held 13.160s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:42:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Acquiring lock "cinder-quobyte-6f4949db-6eb8-4c38-94d2-cee044c09ad8" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:42:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Lock "cinder-quobyte-6f4949db-6eb8-4c38-94d2-cee044c09ad8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:42:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Deleting offline snapshot 6f4949db-6eb8-4c38-94d2-cee044c09ad8 of volume 27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:42:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] snapshot_file for this snap is: volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:42:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd1ebbe-81e9-41e8-bae1-539fd70a6f23]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:42:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:42:59 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 Sep 30 19:42:59 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:00 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8" returned: 0 in 0.911s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b8bc0b-e36b-4277-87da-bf857b8523c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:43:00 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08a6721-45b1-4287-a0ad-b5062a851519]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:00 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 Sep 30 19:43:00 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:01 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7" returned: 0 in 1.154s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:01 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 Sep 30 19:43:01 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (b3cc75ba-e371-4836-a049-e7d3ef779119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b0fb2c-3d16-4d9a-8b5f-b325d079dcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b0fb2c-3d16-4d9a-8b5f-b325d079dcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-106605499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7fc105-d281-40c6-898f-35d71705f9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:01Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89b6089-e0cb-45ad-b4c1-cc9fe0b6dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89b6089-e0cb-45ad-b4c1-cc9fe0b6dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0d7cf1-03fd-4aae-a6cf-a1d173979571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0d7cf1-03fd-4aae-a6cf-a1d173979571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7fc105-d281-40c6-898f-35d71705f9cf', 'volume_name': 'volume-0c7fc105-d281-40c6-898f-35d71705f9cf', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962b7115-91d6-4617-956f-499a971d1763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962b7115-91d6-4617-956f-499a971d1763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a508027-444f-4c6f-920f-04f73e30fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:01 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Volume 0c7fc105-d281-40c6-898f-35d71705f9cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7fc105-d281-40c6-898f-35d71705f9cf', 'volume_size': 1} Sep 30 19:43:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:02 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8" returned: 0 in 0.674s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:02 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8 Sep 30 19:43:02 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:02 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7.6f4949db-6eb8-4c38-94d2-cee044c09ad8" returned: 0 in 0.496s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Lock "cinder-quobyte-6f4949db-6eb8-4c38-94d2-cee044c09ad8" released by "_delete_snapshot" :: held 3.459s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.168s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.970s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-106605499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7fc105-d281-40c6-898f-35d71705f9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:01Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Creating volume 0c7fc105-d281-40c6-898f-35d71705f9cf {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:02 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a628f57-58e3-42c6-b075-b1f33348268b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b', 'volume_size': 2, 'source_volid': '27b8bc0b-e36b-4277-87da-bf857b8523c7', 'source_volstatus': 'available'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9563b73f-2797-476c-839e-aab31e345844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:02 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf 1073741824 Sep 30 19:43:02 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:02 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Volume volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b (819ac7cf-2fcf-4b85-81d5-3cbbec85e96b): created successfully Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9563b73f-2797-476c-839e-aab31e345844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Flow 'volume_create_manager' (bf309912-a335-4871-97b7-f595f1f0ff20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-cc89d2ff-fe4a-48ac-995c-6cc2b57649d5 tempest-VolumesCloneTest-1925026210 None] Created volume successfully. Sep 30 19:43:03 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf 1073741824" returned: 0 in 0.941s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:03 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf Sep 30 19:43:03 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:04 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf" returned: 0 in 0.561s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a508027-444f-4c6f-920f-04f73e30fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7fc105-d281-40c6-898f-35d71705f9cf', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa73fca-5571-47b0-8c23-201375be725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Acquiring lock "cinder-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:04 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Volume volume-0c7fc105-d281-40c6-898f-35d71705f9cf (0c7fc105-d281-40c6-898f-35d71705f9cf): created successfully Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa73fca-5571-47b0-8c23-201375be725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (b3cc75ba-e371-4836-a049-e7d3ef779119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:04 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-50232b61-81f4-4d24-904c-6329bcb5374a tempest-VolumesActionsTest-768336134 None] Created volume successfully. Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Lock "cinder-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b-delete_volume" acquired by "delete_volume" :: waited 0.148s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Acquiring lock "cinder-quobyte-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Lock "cinder-quobyte-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" acquired by "delete_volume" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec1ad8-4989-47ee-9cde-68ed92ef5a0b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:05 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b Sep 30 19:43:05 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:05 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" returned: 0 in 0.717s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:05 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b Sep 30 19:43:05 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a0392355-4d61-4a1f-ac70-f090a64c2031 tempest-VolumesActionsTest-768336134 None] Acquiring lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf" by "attach_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a0392355-4d61-4a1f-ac70-f090a64c2031 tempest-VolumesActionsTest-768336134 None] Lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf" acquired by "attach_volume" :: waited 0.060s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:06 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a0392355-4d61-4a1f-ac70-f090a64c2031 tempest-VolumesActionsTest-768336134 None] Attaching volume 0c7fc105-d281-40c6-898f-35d71705f9cf to instance ca593253-9ce0-4913-8043-b34813ffdc68 at mountpoint /dev/vdb on host None. Sep 30 19:43:06 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a0392355-4d61-4a1f-ac70-f090a64c2031 tempest-VolumesActionsTest-768336134 None] Attach volume completed successfully. Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a0392355-4d61-4a1f-ac70-f090a64c2031 tempest-VolumesActionsTest-768336134 None] Lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf" released by "attach_volume" :: held 0.207s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:06 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" returned: 0 in 0.529s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Lock "cinder-quobyte-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b" released by "delete_volume" :: held 1.327s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Created reservations ['ed04d197-f14d-4236-a267-576084790edd', '885e928b-3388-4f72-8eaf-d98de8375a8f', '1c81ac58-7cd3-4698-a052-2a6c46e7132a', 'e326654b-e0be-4016-ac8f-4161084b85d8'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:06 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:06 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:06 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.392s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:06 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Deleted volume successfully. Sep 30 19:43:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7deaaa4-2f61-4410-a828-787a8624291d tempest-VolumesCloneTest-1925026210 None] Lock "cinder-819ac7cf-2fcf-4b85-81d5-3cbbec85e96b-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Acquiring lock "cinder-27b8bc0b-e36b-4277-87da-bf857b8523c7-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Lock "cinder-27b8bc0b-e36b-4277-87da-bf857b8523c7-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Acquiring lock "cinder-quobyte-27b8bc0b-e36b-4277-87da-bf857b8523c7" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Lock "cinder-quobyte-27b8bc0b-e36b-4277-87da-bf857b8523c7" acquired by "delete_volume" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:07 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3804f86-21c5-4da4-b31b-af351bda49d0]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-23f5037a-38c1-4c30-b5cd-0e74a4bc12bc tempest-VolumesActionsTest-1615298766 None] Terminate volume connection completed successfully. Sep 30 19:43:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-23f5037a-38c1-4c30-b5cd-0e74a4bc12bc tempest-VolumesActionsTest-1615298766 None] Acquiring lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf-detach_volume" by "detach_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:07 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 Sep 30 19:43:07 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-23f5037a-38c1-4c30-b5cd-0e74a4bc12bc tempest-VolumesActionsTest-1615298766 None] Lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-23f5037a-38c1-4c30-b5cd-0e74a4bc12bc tempest-VolumesActionsTest-1615298766 None] Detaching volume 0c7fc105-d281-40c6-898f-35d71705f9cf from instance ca593253-9ce0-4913-8043-b34813ffdc68. Sep 30 19:43:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-23f5037a-38c1-4c30-b5cd-0e74a4bc12bc tempest-VolumesActionsTest-1615298766 None] Detach volume completed successfully. Sep 30 19:43:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-23f5037a-38c1-4c30-b5cd-0e74a4bc12bc tempest-VolumesActionsTest-1615298766 None] Lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf-detach_volume" released by "detach_volume" :: held 0.199s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:08 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7" returned: 0 in 0.728s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:08 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7 Sep 30 19:43:08 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74c6fb47-b79c-4748-bc6c-14304cec6998 tempest-VolumesActionsTest-768336134 None] Acquiring lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf-detach_volume" by "detach_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74c6fb47-b79c-4748-bc6c-14304cec6998 tempest-VolumesActionsTest-768336134 None] Lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:08 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-74c6fb47-b79c-4748-bc6c-14304cec6998 tempest-VolumesActionsTest-768336134 None] Volume detach called, but volume not attached. Sep 30 19:43:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74c6fb47-b79c-4748-bc6c-14304cec6998 tempest-VolumesActionsTest-768336134 None] Lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:08 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-27b8bc0b-e36b-4277-87da-bf857b8523c7" returned: 0 in 0.726s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Lock "cinder-quobyte-27b8bc0b-e36b-4277-87da-bf857b8523c7" released by "delete_volume" :: held 1.633s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Acquiring lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Created reservations ['6fc88f72-0b02-46f0-a56a-fb0e090a0ec7', '5e6faab0-4650-4b0a-9496-89adad8d2f48', '55bda3e8-afd0-44da-aefa-8d5b0cc0fce3', 'e5c0e2ad-9a2d-44b7-975b-244a3df23dbb'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Acquiring lock "cinder-quobyte-0c7fc105-d281-40c6-898f-35d71705f9cf" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Lock "cinder-quobyte-0c7fc105-d281-40c6-898f-35d71705f9cf" acquired by "delete_volume" :: waited 0.081s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[834a77d7-9a33-4748-805f-1ad72c9c01dd]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:09 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:09 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:09 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf Sep 30 19:43:09 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:10 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.649s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:10 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:10 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Deleted volume successfully. Sep 30 19:43:10 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf" returned: 0 in 0.813s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-625807da-1c20-4ff5-b96b-c72a75449527 tempest-VolumesCloneTest-1925026210 None] Lock "cinder-27b8bc0b-e36b-4277-87da-bf857b8523c7-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:10 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf Sep 30 19:43:10 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:10 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0c7fc105-d281-40c6-898f-35d71705f9cf" returned: 0 in 0.672s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Lock "cinder-quobyte-0c7fc105-d281-40c6-898f-35d71705f9cf" released by "delete_volume" :: held 1.600s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:11 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Created reservations ['4c833aef-0e17-4bcb-8560-a82d0669b1b8', 'c331d3e2-08e1-4306-9c2e-7e398a8d43de', '27f20f22-d699-4235-be15-7e4ce6665a26', '068c3ad8-d28a-4920-8b17-32e2497efc66'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:11 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:11 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:12 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.688s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:12 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Deleted volume successfully. Sep 30 19:43:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-651200f2-2cef-4058-846c-28c6ea5a4e91 tempest-VolumesActionsTest-768336134 None] Lock "cinder-0c7fc105-d281-40c6-898f-35d71705f9cf-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:15 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (f6a9e393-3591-4a1a-b0cc-b0a5accfdfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178e20f9-0720-4d6d-9469-e02183619ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178e20f9-0720-4d6d-9469-e02183619ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2144612417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9839029-0d44-44bd-bfbb-97642fa7a3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:16Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62eb3537-117c-4496-b830-4c193c6ae847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62eb3537-117c-4496-b830-4c193c6ae847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4813c3d6-5b5b-47a2-9e91-cbd1b5c256d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4813c3d6-5b5b-47a2-9e91-cbd1b5c256d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9839029-0d44-44bd-bfbb-97642fa7a3fa', 'volume_name': 'volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697f62ae-6f3a-4e2f-89c2-f07ee167c4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697f62ae-6f3a-4e2f-89c2-f07ee167c4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0f5342-871b-4897-b0e6-3168b2b086f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Volume c9839029-0d44-44bd-bfbb-97642fa7a3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa', 'volume_size': 1} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2144612417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9839029-0d44-44bd-bfbb-97642fa7a3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:16Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Creating volume c9839029-0d44-44bd-bfbb-97642fa7a3fa {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:16 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:16 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa 1073741824 Sep 30 19:43:16 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:16 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Flow 'volume_create_manager' (9a84dc21-0000-4d4b-a241-277352f40ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c71a64-781c-48dc-8d64-13211dfffbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa 1073741824" returned: 0 in 0.704s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c71a64-781c-48dc-8d64-13211dfffbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-590873282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c3277e-8ae6-4f2e-9dd2-7942847fac5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35d07d3472542679b5c06a563200b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:17Z,use_quota=True,user_id='8815b1dc38e942109b8aee0fe3a57619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779afe61-7d6e-4d0a-95af-f1253f1ede92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779afe61-7d6e-4d0a-95af-f1253f1ede92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5ad804-aab5-4263-95f3-3d117eaef79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5ad804-aab5-4263-95f3-3d117eaef79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c3277e-8ae6-4f2e-9dd2-7942847fac5c', 'volume_name': 'volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c', 'volume_size': 2}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55070dd-7c77-4698-b9f6-f8a1779e36e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55070dd-7c77-4698-b9f6-f8a1779e36e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bbb988-7ff5-4afc-94a4-fb1ddbb65c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:16 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Volume d5c3277e-8ae6-4f2e-9dd2-7942847fac5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c', 'volume_size': 2} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:16 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa Sep 30 19:43:16 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:17 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa" returned: 0 in 0.293s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-590873282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c3277e-8ae6-4f2e-9dd2-7942847fac5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35d07d3472542679b5c06a563200b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:17Z,use_quota=True,user_id='8815b1dc38e942109b8aee0fe3a57619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Creating volume d5c3277e-8ae6-4f2e-9dd2-7942847fac5c {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:17 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c 2147483648 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0f5342-871b-4897-b0e6-3168b2b086f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55c8b07-0147-4928-ac08-c8c7a341939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:17 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c 2147483648 Sep 30 19:43:17 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:17 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Volume volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa (c9839029-0d44-44bd-bfbb-97642fa7a3fa): created successfully Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55c8b07-0147-4928-ac08-c8c7a341939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (f6a9e393-3591-4a1a-b0cc-b0a5accfdfec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:17 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-20823b11-0c71-426b-bce0-71db0336e41e tempest-VolumesActionsTest-768336134 None] Created volume successfully. Sep 30 19:43:17 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c 2147483648" returned: 0 in 0.537s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:17 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c Sep 30 19:43:17 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:18 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bbb988-7ff5-4afc-94a4-fb1ddbb65c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c', 'volume_size': 2}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207ffa32-71a6-4aeb-802f-2721bd52e5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:18 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Volume volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c (d5c3277e-8ae6-4f2e-9dd2-7942847fac5c): created successfully Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207ffa32-71a6-4aeb-802f-2721bd52e5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Flow 'volume_create_manager' (9a84dc21-0000-4d4b-a241-277352f40ac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-02a36503-a068-461a-b78b-32eca0bb3197 tempest-VolumesCloneNegativeTest-187168653 None] Created volume successfully. Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Acquiring lock "cinder-c9839029-0d44-44bd-bfbb-97642fa7a3fa-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Lock "cinder-c9839029-0d44-44bd-bfbb-97642fa7a3fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Acquiring lock "cinder-quobyte-c9839029-0d44-44bd-bfbb-97642fa7a3fa" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Lock "cinder-quobyte-c9839029-0d44-44bd-bfbb-97642fa7a3fa" acquired by "delete_volume" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8e525f-b86c-41ef-a567-7098b3508f1d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:18 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa Sep 30 19:43:18 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:19 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa" returned: 0 in 0.654s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:19 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa Sep 30 19:43:19 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Acquiring lock "cinder-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Lock "cinder-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Acquiring lock "cinder-quobyte-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Lock "cinder-quobyte-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c" acquired by "delete_volume" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df8ab6-9895-4800-b23b-69fa72b9fd3a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:19 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:19 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c9839029-0d44-44bd-bfbb-97642fa7a3fa" returned: 0 in 0.672s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:19 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Lock "cinder-quobyte-c9839029-0d44-44bd-bfbb-97642fa7a3fa" released by "delete_volume" :: held 1.378s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Created reservations ['32c1a6e6-2efc-471f-bca0-099981ee067a', '2fadf162-3a0c-4be1-84a9-82ee5668668a', 'ba62fd81-1014-4897-a602-eb57260010f0', '62dc1173-ac33-40a5-a31a-3cfaa261895e'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:19 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:19 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:20 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c" returned: 0 in 0.569s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:20 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c Sep 30 19:43:20 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:20 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.313s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Deleted volume successfully. Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bc438f1-10d3-4ded-a6d0-f25e2233f257 tempest-VolumesActionsTest-1615298766 None] Lock "cinder-c9839029-0d44-44bd-bfbb-97642fa7a3fa-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:20 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c" returned: 0 in 0.294s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Lock "cinder-quobyte-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c" released by "delete_volume" :: held 0.951s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Created reservations ['c52d1fad-9a28-4fd3-9958-2dba2fcbb427', '1fa84c78-6d5f-4620-ad87-4d975ef27068', 'd898ad13-3c37-4d48-9ae5-453921afd103', '2735f496-238e-400d-b619-50e254dcdbaa'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:20 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:20 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:20 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.341s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Deleted volume successfully. Sep 30 19:43:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-951d11ea-bf34-4110-920e-3fd7d9074a26 tempest-VolumesCloneNegativeTest-187168653 None] Lock "cinder-d5c3277e-8ae6-4f2e-9dd2-7942847fac5c-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (fab94de6-ef37-4031-8be0-d5fd8766db1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87090b82-1109-4e75-a785-2ce62d92f9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87090b82-1109-4e75-a785-2ce62d92f9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1891397847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8257f8d-446d-4092-8cc7-0b147f54af90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:21Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9a5be4-0d76-403d-9db4-f6bd2fde4fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9a5be4-0d76-403d-9db4-f6bd2fde4fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0f94b7-1f53-45cb-a0a8-17c8e7ab715f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0f94b7-1f53-45cb-a0a8-17c8e7ab715f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8257f8d-446d-4092-8cc7-0b147f54af90', 'volume_name': 'volume-e8257f8d-446d-4092-8cc7-0b147f54af90', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d074f131-2fb9-450d-9bfe-b73f7c819da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d074f131-2fb9-450d-9bfe-b73f7c819da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608802ea-3f6a-4f29-afa9-9d5cd952ba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:21 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Volume e8257f8d-446d-4092-8cc7-0b147f54af90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8257f8d-446d-4092-8cc7-0b147f54af90', 'volume_size': 1} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1891397847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8257f8d-446d-4092-8cc7-0b147f54af90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:21Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Creating volume e8257f8d-446d-4092-8cc7-0b147f54af90 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:21 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:21 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90 1073741824 Sep 30 19:43:21 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:22 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90 1073741824" returned: 0 in 0.566s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:22 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90 Sep 30 19:43:22 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:22 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90" returned: 0 in 0.391s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608802ea-3f6a-4f29-afa9-9d5cd952ba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8257f8d-446d-4092-8cc7-0b147f54af90', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bdbc51-dbd0-484b-bcb4-e00dc284212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:22 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Volume volume-e8257f8d-446d-4092-8cc7-0b147f54af90 (e8257f8d-446d-4092-8cc7-0b147f54af90): created successfully Sep 30 19:43:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bdbc51-dbd0-484b-bcb4-e00dc284212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (fab94de6-ef37-4031-8be0-d5fd8766db1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:22 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-64953d3a-4d95-4430-bee9-f026355920b5 tempest-VolumesActionsTest-768336134 None] Created volume successfully. Sep 30 19:43:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Acquiring lock "cinder-e8257f8d-446d-4092-8cc7-0b147f54af90-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Lock "cinder-e8257f8d-446d-4092-8cc7-0b147f54af90-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:43:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Acquiring lock "cinder-quobyte-e8257f8d-446d-4092-8cc7-0b147f54af90" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:24 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:24 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Lock "cinder-quobyte-e8257f8d-446d-4092-8cc7-0b147f54af90" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2234a9-edf8-4c94-8e2e-b8d34fa8286c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:24 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90 Sep 30 19:43:24 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:24 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.619s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:43:24 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90" returned: 0 in 0.753s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:24 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90 Sep 30 19:43:24 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:25 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e8257f8d-446d-4092-8cc7-0b147f54af90" returned: 0 in 0.624s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Lock "cinder-quobyte-e8257f8d-446d-4092-8cc7-0b147f54af90" released by "delete_volume" :: held 1.499s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:25 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Created reservations ['6c430765-bf39-4e1f-81c8-550c5ff06d30', '542fffcc-3834-4f95-8215-7045605b5019', '8369719a-8daa-45a5-8619-bbe1d64734bf', '73a5a566-082b-4886-b395-7168e20acc9e'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:25 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:25 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Flow 'volume_create_manager' (18cee804-fcc0-43ce-9909-80a8001a1a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf76984d-48e2-492a-8a23-bfff409c3816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:26 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.666s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf76984d-48e2-492a-8a23-bfff409c3816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-616953220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19537f02-4314-4b29-b811-c741fa25f5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6178139e3d4e18b52725b563f4bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:26Z,use_quota=True,user_id='a175b2c5dd964331a84360accf02f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b6f42c-77ff-49a8-9ed6-a54b9a0fc2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b6f42c-77ff-49a8-9ed6-a54b9a0fc2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155e20af-dd7b-477e-ac16-8dd79ab8c907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155e20af-dd7b-477e-ac16-8dd79ab8c907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19537f02-4314-4b29-b811-c741fa25f5c1', 'volume_name': 'volume-19537f02-4314-4b29-b811-c741fa25f5c1', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773304b2-849b-457e-94d4-b1021aa0c632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773304b2-849b-457e-94d4-b1021aa0c632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f07ad30-2ac1-4cb6-9211-044243b3bb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:26 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Volume 19537f02-4314-4b29-b811-c741fa25f5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19537f02-4314-4b29-b811-c741fa25f5c1', 'volume_size': 1} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-616953220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19537f02-4314-4b29-b811-c741fa25f5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6178139e3d4e18b52725b563f4bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:26Z,use_quota=True,user_id='a175b2c5dd964331a84360accf02f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Creating volume 19537f02-4314-4b29-b811-c741fa25f5c1 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:26 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:26 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Deleted volume successfully. Sep 30 19:43:26 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1 1073741824 Sep 30 19:43:26 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb972ddc-3365-4c8f-9ec3-988a1aa1fe8e tempest-VolumesActionsTest-1615298766 None] Lock "cinder-e8257f8d-446d-4092-8cc7-0b147f54af90-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (e8e8cfe2-966d-4c06-8733-3fbb736344c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c80df6-025f-459c-93ec-d5de9598cac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c80df6-025f-459c-93ec-d5de9598cac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894619598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c923ad-0616-4907-9026-a8e78d5495a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:27Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf1ef27-ba94-4cbd-a7ab-d2a8d8d8ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf1ef27-ba94-4cbd-a7ab-d2a8d8d8ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a08d163-98b8-4e94-b600-9e2b86250189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a08d163-98b8-4e94-b600-9e2b86250189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c923ad-0616-4907-9026-a8e78d5495a2', 'volume_name': 'volume-40c923ad-0616-4907-9026-a8e78d5495a2', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989f0a4b-c51a-4159-a80d-b117acd62856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989f0a4b-c51a-4159-a80d-b117acd62856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5678534-20ce-4add-8815-52b41a6f1f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Volume 40c923ad-0616-4907-9026-a8e78d5495a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c923ad-0616-4907-9026-a8e78d5495a2', 'volume_size': 1} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:27 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1 1073741824" returned: 0 in 0.624s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:27 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1 Sep 30 19:43:27 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:27 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1" returned: 0 in 0.349s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894619598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c923ad-0616-4907-9026-a8e78d5495a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:27Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Creating volume 40c923ad-0616-4907-9026-a8e78d5495a2 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:27 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:27 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2 1073741824 Sep 30 19:43:27 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f07ad30-2ac1-4cb6-9211-044243b3bb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19537f02-4314-4b29-b811-c741fa25f5c1', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e50a7c5-b498-4e6a-bb0d-82a8ad242ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Volume volume-19537f02-4314-4b29-b811-c741fa25f5c1 (19537f02-4314-4b29-b811-c741fa25f5c1): created successfully Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e50a7c5-b498-4e6a-bb0d-82a8ad242ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Flow 'volume_create_manager' (18cee804-fcc0-43ce-9909-80a8001a1a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b0e0e369-edd3-4909-9a4d-6821c3bd99fc tempest-AttachVolumeNegativeTest-1406576198 None] Created volume successfully. Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Flow 'volume_create_manager' (201fd4cb-c37b-4b24-a60c-efb8815f53af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4df4150-476b-457a-b131-81379531c4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4df4150-476b-457a-b131-81379531c4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-814970238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94a1ead-06fc-4e8b-9ccd-836b0e626600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c45b1189a0f4a87966ff67ece603bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:28Z,use_quota=True,user_id='87cf462ef6f747e38d67d82a2c96c866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223e0e1a-9ef8-4a44-83ad-142a5ef726ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223e0e1a-9ef8-4a44-83ad-142a5ef726ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ed1090-a247-4388-b467-dd459de7e3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ed1090-a247-4388-b467-dd459de7e3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94a1ead-06fc-4e8b-9ccd-836b0e626600', 'volume_name': 'volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6a0fcb-83a8-4495-9e6d-a8f1623ea830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6a0fcb-83a8-4495-9e6d-a8f1623ea830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06335d5-1c80-496b-bb61-44027811be98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Volume c94a1ead-06fc-4e8b-9ccd-836b0e626600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600', 'volume_size': 1} Sep 30 19:43:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:28 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2 1073741824" returned: 0 in 0.505s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:28 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2 Sep 30 19:43:28 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:28 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2" returned: 0 in 0.269s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-814970238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94a1ead-06fc-4e8b-9ccd-836b0e626600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c45b1189a0f4a87966ff67ece603bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:28Z,use_quota=True,user_id='87cf462ef6f747e38d67d82a2c96c866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Creating volume c94a1ead-06fc-4e8b-9ccd-836b0e626600 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:28 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5678534-20ce-4add-8815-52b41a6f1f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c923ad-0616-4907-9026-a8e78d5495a2', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:28 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 1073741824 Sep 30 19:43:28 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fc8dd6-14e8-4cdb-9bd0-d93184c02825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:28 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Volume volume-40c923ad-0616-4907-9026-a8e78d5495a2 (40c923ad-0616-4907-9026-a8e78d5495a2): created successfully Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fc8dd6-14e8-4cdb-9bd0-d93184c02825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (e8e8cfe2-966d-4c06-8733-3fbb736344c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0b584887-6ec0-4987-85c2-be311f9923ab tempest-VolumesActionsTest-768336134 None] Created volume successfully. Sep 30 19:43:29 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 1073741824" returned: 0 in 0.632s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:29 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 Sep 30 19:43:29 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Acquiring lock "cinder-40c923ad-0616-4907-9026-a8e78d5495a2-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Lock "cinder-40c923ad-0616-4907-9026-a8e78d5495a2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Acquiring lock "cinder-quobyte-40c923ad-0616-4907-9026-a8e78d5495a2" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Lock "cinder-quobyte-40c923ad-0616-4907-9026-a8e78d5495a2" acquired by "delete_volume" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f876e62-d5af-44dc-9c95-bad367e91797]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:29 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600" returned: 0 in 0.387s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:29 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2 Sep 30 19:43:29 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06335d5-1c80-496b-bb61-44027811be98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8268134e-071c-4418-99b0-7475e70eef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:29 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Volume volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 (c94a1ead-06fc-4e8b-9ccd-836b0e626600): created successfully Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8268134e-071c-4418-99b0-7475e70eef02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Flow 'volume_create_manager' (201fd4cb-c37b-4b24-a60c-efb8815f53af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:29 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-26407534-de6b-4b56-9b62-158483614d26 tempest-VolumesNegativeTest-2035082330 None] Created volume successfully. Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-197c6759-159a-4b11-bcc6-95abef21b9cf req-85ed7f98-59d6-4d14-9bba-6ffbe326a864 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-197c6759-159a-4b11-bcc6-95abef21b9cf req-85ed7f98-59d6-4d14-9bba-6ffbe326a864 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-197c6759-159a-4b11-bcc6-95abef21b9cf req-85ed7f98-59d6-4d14-9bba-6ffbe326a864 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-197c6759-159a-4b11-bcc6-95abef21b9cf req-85ed7f98-59d6-4d14-9bba-6ffbe326a864 tempest-AttachVolumeNegativeTest-1406576198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-19537f02-4314-4b29-b811-c741fa25f5c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a77365e3-2ad6-434e-8325-16711e5e2159', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:43:29 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-197c6759-159a-4b11-bcc6-95abef21b9cf req-85ed7f98-59d6-4d14-9bba-6ffbe326a864 tempest-AttachVolumeNegativeTest-1406576198 None] attachment_update completed successfully. Sep 30 19:43:29 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2" returned: 0 in 0.475s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:29 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2 Sep 30 19:43:29 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:30 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-40c923ad-0616-4907-9026-a8e78d5495a2" returned: 0 in 0.361s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Lock "cinder-quobyte-40c923ad-0616-4907-9026-a8e78d5495a2" released by "delete_volume" :: held 0.930s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Created reservations ['3df6dcfb-bdd4-4b4b-a99c-d230cb1cfde0', '7b9ae605-6b2d-4dc6-8896-c0da1482dbc8', 'e77cb348-d393-4a84-b5b6-adfb5cd1e5f5', 'dac64af7-5ac3-4aa7-9214-45479424d9ac'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:30 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:30 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:30 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:30 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Deleted volume successfully. Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e52a4971-b474-4fbb-8d2f-c420dadc59dd tempest-VolumesActionsTest-1615298766 None] Lock "cinder-40c923ad-0616-4907-9026-a8e78d5495a2-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (80db78cd-60c5-4db5-a96d-86f50e500fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b742ddd-ca71-46ac-aca8-bf4d24021549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b742ddd-ca71-46ac-aca8-bf4d24021549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1385448389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8884bb2-e742-4155-9b9a-903b66a675c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:32Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b7061b-c7f7-4e27-93e9-64133d4de85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b7061b-c7f7-4e27-93e9-64133d4de85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542608cc-bfbf-4e03-aff6-1b1cbb76050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542608cc-bfbf-4e03-aff6-1b1cbb76050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8884bb2-e742-4155-9b9a-903b66a675c2', 'volume_name': 'volume-d8884bb2-e742-4155-9b9a-903b66a675c2', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61b9744-bbf6-4a39-92b5-a1b98c52dc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61b9744-bbf6-4a39-92b5-a1b98c52dc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03a646e-f201-4b4e-b89e-a9c5b95d3ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:31 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Volume d8884bb2-e742-4155-9b9a-903b66a675c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8884bb2-e742-4155-9b9a-903b66a675c2', 'volume_size': 1} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1385448389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8884bb2-e742-4155-9b9a-903b66a675c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:32Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Creating volume d8884bb2-e742-4155-9b9a-903b66a675c2 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:31 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:31 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2 1073741824 Sep 30 19:43:31 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:32 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2 1073741824" returned: 0 in 0.837s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:32 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2 Sep 30 19:43:32 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:33 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2" returned: 0 in 0.552s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03a646e-f201-4b4e-b89e-a9c5b95d3ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8884bb2-e742-4155-9b9a-903b66a675c2', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b962ddd-052f-413b-bc99-9075e9698aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:33 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Volume volume-d8884bb2-e742-4155-9b9a-903b66a675c2 (d8884bb2-e742-4155-9b9a-903b66a675c2): created successfully Sep 30 19:43:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b962ddd-052f-413b-bc99-9075e9698aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (80db78cd-60c5-4db5-a96d-86f50e500fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:33 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-cf3e1d2b-b209-4945-b32b-9f8a87cfb6f8 tempest-VolumesActionsTest-768336134 None] Created volume successfully. Sep 30 19:43:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Acquiring lock "cinder-d8884bb2-e742-4155-9b9a-903b66a675c2-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Lock "cinder-d8884bb2-e742-4155-9b9a-903b66a675c2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Acquiring lock "cinder-quobyte-d8884bb2-e742-4155-9b9a-903b66a675c2" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Lock "cinder-quobyte-d8884bb2-e742-4155-9b9a-903b66a675c2" acquired by "delete_volume" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:34 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fa6c95-f77c-48fa-8bc3-fece82e78832]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:34 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2 Sep 30 19:43:34 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:34 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2" returned: 0 in 0.614s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:34 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2 Sep 30 19:43:34 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:35 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d8884bb2-e742-4155-9b9a-903b66a675c2" returned: 0 in 0.328s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Lock "cinder-quobyte-d8884bb2-e742-4155-9b9a-903b66a675c2" released by "delete_volume" :: held 1.092s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:35 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Created reservations ['3c27b833-5a6b-4cb3-9ea5-bed1b7df5862', '0b129827-11f7-46a1-a986-576620f94bd7', '7fcadee9-05c7-4e6d-af63-4996ebec51a7', 'b19e2737-0bf6-447b-8d5f-1b1715162033'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:35 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:35 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:35 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.311s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:36 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:36 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Deleted volume successfully. Sep 30 19:43:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-97b09135-7cb7-4c46-85c5-58dde35c4126 tempest-VolumesActionsTest-1615298766 None] Lock "cinder-d8884bb2-e742-4155-9b9a-903b66a675c2-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (d411c7ff-2946-4417-8430-344883d84476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbfcb61-9fab-48c8-a6a4-cfcaab7e99a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbfcb61-9fab-48c8-a6a4-cfcaab7e99a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771907942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5be677-53f7-4a10-b66c-7a61ca8b2671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:37Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389eb15f-8165-43d5-90f2-4aba91c5946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389eb15f-8165-43d5-90f2-4aba91c5946e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f0fb3e-0e64-4f42-b8ec-124e5e303e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f0fb3e-0e64-4f42-b8ec-124e5e303e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f5be677-53f7-4a10-b66c-7a61ca8b2671', 'volume_name': 'volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018efadd-fc76-416f-b906-1597fb3d332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018efadd-fc76-416f-b906-1597fb3d332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80355ff-5893-4d35-b3e7-e91701493f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:37 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Volume 9f5be677-53f7-4a10-b66c-7a61ca8b2671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671', 'volume_size': 1} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771907942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5be677-53f7-4a10-b66c-7a61ca8b2671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca43caa247747d2b11a4a01521e3000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:37Z,use_quota=True,user_id='e94b5c638305483693318f7c5927dd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Creating volume 9f5be677-53f7-4a10-b66c-7a61ca8b2671 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:37 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:37 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 1073741824 Sep 30 19:43:37 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:38 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 1073741824" returned: 0 in 0.871s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:38 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 Sep 30 19:43:38 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:38 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671" returned: 0 in 0.561s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80355ff-5893-4d35-b3e7-e91701493f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119a3ca6-85ef-4078-a6e8-b4de989aa240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:38 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Volume volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 (9f5be677-53f7-4a10-b66c-7a61ca8b2671): created successfully Sep 30 19:43:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119a3ca6-85ef-4078-a6e8-b4de989aa240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Flow 'volume_create_manager' (d411c7ff-2946-4417-8430-344883d84476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:38 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-60288c5a-b783-4066-ac14-7f63bd82f38f tempest-VolumesActionsTest-768336134 None] Created volume successfully. Sep 30 19:43:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Acquiring lock "cinder-9f5be677-53f7-4a10-b66c-7a61ca8b2671-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Lock "cinder-9f5be677-53f7-4a10-b66c-7a61ca8b2671-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Acquiring lock "cinder-quobyte-9f5be677-53f7-4a10-b66c-7a61ca8b2671" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Lock "cinder-quobyte-9f5be677-53f7-4a10-b66c-7a61ca8b2671" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:40 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff5d613-61a2-46fa-ba78-1d674a59c849]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:40 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 Sep 30 19:43:40 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:41 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671" returned: 0 in 0.569s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:41 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671 Sep 30 19:43:41 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:41 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9f5be677-53f7-4a10-b66c-7a61ca8b2671" returned: 0 in 0.329s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Lock "cinder-quobyte-9f5be677-53f7-4a10-b66c-7a61ca8b2671" released by "delete_volume" :: held 0.964s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Created reservations ['062f7f4c-8992-4472-a16b-4e5e2bba4f1f', 'b83881ba-eaba-4528-9db7-fb668a4a6777', '24782db8-30f2-40cf-8a29-718eb96dde1f', '56bb2bd1-dbd8-4efb-b62b-9cf52a080ee7'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:41 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:41 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:42 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.374s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:42 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Deleted volume successfully. Sep 30 19:43:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-926420be-1572-41a8-b299-6cf66abce123 tempest-VolumesActionsTest-768336134 None] Lock "cinder-9f5be677-53f7-4a10-b66c-7a61ca8b2671-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Flow 'volume_create_manager' (5f6d0f59-8687-41dd-96ef-0b699a12f2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1005a31-f113-4de7-8c44-7ce6e40f1762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1005a31-f113-4de7-8c44-7ce6e40f1762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-931361284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34d82f4-9853-4cad-9bd0-4131e5c513e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df23c2ecd1594388ab809ff321f3c356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:47Z,use_quota=True,user_id='c604a2610b554328851afd76201c06f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4642ed-e348-4e50-bb6f-9092e0b0d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4642ed-e348-4e50-bb6f-9092e0b0d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c67963-b2f3-45d4-9190-251cc0ef0702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c67963-b2f3-45d4-9190-251cc0ef0702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34d82f4-9853-4cad-9bd0-4131e5c513e6', 'volume_name': 'volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6016e8-c477-4521-8818-41fa4259a654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6016e8-c477-4521-8818-41fa4259a654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f4665c-d172-46d6-87bd-a60d4835f337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:47 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Volume b34d82f4-9853-4cad-9bd0-4131e5c513e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6', 'volume_size': 1} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-931361284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34d82f4-9853-4cad-9bd0-4131e5c513e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df23c2ecd1594388ab809ff321f3c356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:43:47Z,use_quota=True,user_id='c604a2610b554328851afd76201c06f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Creating volume b34d82f4-9853-4cad-9bd0-4131e5c513e6 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:43:47 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:43:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:47 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 1073741824 Sep 30 19:43:47 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:48 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 1073741824" returned: 0 in 0.727s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:48 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 Sep 30 19:43:48 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:48 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6" returned: 0 in 0.713s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:43:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f4665c-d172-46d6-87bd-a60d4835f337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4af4da-7114-4e15-b5ad-a287bbcd77cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:43:48 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Volume volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 (b34d82f4-9853-4cad-9bd0-4131e5c513e6): created successfully Sep 30 19:43:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4af4da-7114-4e15-b5ad-a287bbcd77cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:43:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Flow 'volume_create_manager' (5f6d0f59-8687-41dd-96ef-0b699a12f2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:43:49 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ec2a73c3-3f1d-4e84-a97c-437a90bce859 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Created volume successfully. Sep 30 19:43:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-9bc2e888-ff65-470e-926f-66331a9b04b0 req-e7f88d8b-b11a-467b-a23c-1307d3c9f2c0 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-9bc2e888-ff65-470e-926f-66331a9b04b0 req-e7f88d8b-b11a-467b-a23c-1307d3c9f2c0 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-9bc2e888-ff65-470e-926f-66331a9b04b0 req-e7f88d8b-b11a-467b-a23c-1307d3c9f2c0 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-9bc2e888-ff65-470e-926f-66331a9b04b0 req-e7f88d8b-b11a-467b-a23c-1307d3c9f2c0 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4bd79dba-d68c-4c3d-8ee3-443a5c064bbb', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:43:51 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-9bc2e888-ff65-470e-926f-66331a9b04b0 req-e7f88d8b-b11a-467b-a23c-1307d3c9f2c0 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] attachment_update completed successfully. Sep 30 19:43:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-2dc55acf-22c5-41e5-94ac-0b05469c3e62 req-a83a16a6-c8e0-414f-9e4e-233987bc1339 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Terminate volume connection completed successfully. Sep 30 19:43:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-2dc55acf-22c5-41e5-94ac-0b05469c3e62 req-a83a16a6-c8e0-414f-9e4e-233987bc1339 tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Deleting attachment 4bd79dba-d68c-4c3d-8ee3-443a5c064bbb. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:43:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Acquiring lock "cinder-b34d82f4-9853-4cad-9bd0-4131e5c513e6-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "cinder-b34d82f4-9853-4cad-9bd0-4131e5c513e6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=116,cinder:SELECT=90,cinder:INSERT=30,cinder:DELETE=16 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=95,cinder:UPDATE=118,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Acquiring lock "cinder-quobyte-b34d82f4-9853-4cad-9bd0-4131e5c513e6" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "cinder-quobyte-b34d82f4-9853-4cad-9bd0-4131e5c513e6" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6c3b61-95a7-44ee-91c1-96d42cf645c4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:56 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 Sep 30 19:43:56 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Acquiring lock "cinder-c94a1ead-06fc-4e8b-9ccd-836b0e626600-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Lock "cinder-c94a1ead-06fc-4e8b-9ccd-836b0e626600-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Acquiring lock "cinder-quobyte-c94a1ead-06fc-4e8b-9ccd-836b0e626600" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Lock "cinder-quobyte-c94a1ead-06fc-4e8b-9ccd-836b0e626600" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:43:56 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6" returned: 0 in 0.665s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ee01af-6255-40b4-8b3d-cefc54a4bb5b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:43:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:56 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6 Sep 30 19:43:56 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:57 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 Sep 30 19:43:57 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:57 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b34d82f4-9853-4cad-9bd0-4131e5c513e6" returned: 0 in 0.368s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "cinder-quobyte-b34d82f4-9853-4cad-9bd0-4131e5c513e6" released by "delete_volume" :: held 1.130s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Created reservations ['27d6ac04-4edc-4602-b01e-1cd1ffc9cfe5', 'd346de3e-f981-40f7-a11a-e19946ee91c5', '695cd4fc-7f2d-47ac-9cdc-52f7af98bd55', '32ff04ae-b2fb-4db9-8d67-81e9a4930ff1'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:57 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:57 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:57 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600" returned: 0 in 0.581s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:57 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600 Sep 30 19:43:57 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:57 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.333s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Deleted volume successfully. Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3b3d87d-c473-4180-82f3-4e50c735c67d tempest-TestServerVolumeAttachScenarioOldVersion-2146603371 None] Lock "cinder-b34d82f4-9853-4cad-9bd0-4131e5c513e6-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:57 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c94a1ead-06fc-4e8b-9ccd-836b0e626600" returned: 0 in 0.386s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Lock "cinder-quobyte-c94a1ead-06fc-4e8b-9ccd-836b0e626600" released by "delete_volume" :: held 1.032s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Created reservations ['6fdd358b-04a8-445a-ae39-920f91658f15', '3e7c24df-9c46-4c00-aa4a-da9480ad44fb', 'b7ff2d31-748f-45cd-bf96-f2d64907a4af', '5a3949b3-aa78-45a0-b43a-5c1018e9ab62'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:43:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:43:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:43:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:43:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:43:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:43:58 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:43:58 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:43:58 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 30 19:43:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.297s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:43:58 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:43:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Deleted volume successfully. Sep 30 19:43:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-08338b47-a4f9-4e3e-bc6b-cdea58cbc04d tempest-VolumesNegativeTest-2035082330 None] Lock "cinder-c94a1ead-06fc-4e8b-9ccd-836b0e626600-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:07 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=18 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Flow 'volume_create_manager' (b5b992dc-0d98-4dc5-b426-61b0fb20039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcda1c0-a55b-4113-8510-92cd1efca0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcda1c0-a55b-4113-8510-92cd1efca0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1737760254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66fbd28b-7f52-46bb-9ed7-89d54a724e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda89517c7dd41ec89eb2622fab60d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:08Z,use_quota=True,user_id='77d5b5123a9d4b278b445f05050143b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381520e1-47f5-48eb-9151-710d8d705e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381520e1-47f5-48eb-9151-710d8d705e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d00d56c-d84c-4b2b-9457-0ae73d697270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d00d56c-d84c-4b2b-9457-0ae73d697270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66fbd28b-7f52-46bb-9ed7-89d54a724e9e', 'volume_name': 'volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033e96b1-8bdd-4b8f-ad91-b20ec2a07785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033e96b1-8bdd-4b8f-ad91-b20ec2a07785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4f472f-74cf-4d7b-9ec4-1fcbca44ed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:08 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Volume 66fbd28b-7f52-46bb-9ed7-89d54a724e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e', 'volume_size': 1} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1737760254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66fbd28b-7f52-46bb-9ed7-89d54a724e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda89517c7dd41ec89eb2622fab60d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:08Z,use_quota=True,user_id='77d5b5123a9d4b278b445f05050143b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Creating volume 66fbd28b-7f52-46bb-9ed7-89d54a724e9e {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:08 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:08 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e 1073741824 Sep 30 19:44:08 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:08 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e 1073741824" returned: 0 in 0.629s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:08 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e Sep 30 19:44:08 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:09 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e" returned: 0 in 0.303s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4f472f-74cf-4d7b-9ec4-1fcbca44ed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40a95dd-cd4a-43f1-8e17-19b2895c9e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:09 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Volume volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e (66fbd28b-7f52-46bb-9ed7-89d54a724e9e): created successfully Sep 30 19:44:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40a95dd-cd4a-43f1-8e17-19b2895c9e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Flow 'volume_create_manager' (b5b992dc-0d98-4dc5-b426-61b0fb20039c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1793fb8b-6dfc-4938-9ddd-c93a5a02dc67 tempest-VolumesTransfersV357Test-419884361 None] Created volume successfully. Sep 30 19:44:11 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-221bbb4f-d8a9-4428-a695-501638376325 tempest-VolumesTransfersV357Test-1540523216 None] Transfer volume completed successfully. Sep 30 19:44:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Acquiring lock "cinder-66fbd28b-7f52-46bb-9ed7-89d54a724e9e-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Lock "cinder-66fbd28b-7f52-46bb-9ed7-89d54a724e9e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Acquiring lock "cinder-quobyte-66fbd28b-7f52-46bb-9ed7-89d54a724e9e" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Lock "cinder-quobyte-66fbd28b-7f52-46bb-9ed7-89d54a724e9e" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:12 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4f5e16-651a-4d61-bb87-e6a6d15fecf5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:44:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:12 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e Sep 30 19:44:12 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:13 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e" returned: 0 in 0.494s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:13 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e Sep 30 19:44:13 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:13 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66fbd28b-7f52-46bb-9ed7-89d54a724e9e" returned: 0 in 0.298s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Lock "cinder-quobyte-66fbd28b-7f52-46bb-9ed7-89d54a724e9e" released by "delete_volume" :: held 0.868s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Created reservations ['e69cbe97-47d0-4b95-a9c5-cbcd2c5d208d', 'd8ee2c87-edb6-4c7a-a5ed-adfb3ec3580a', '5b49ec8d-cd9f-42ee-af37-539092839e90', '8c208582-a12e-43fd-9fc7-aad698655510'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:13 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:44:13 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:14 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.356s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:44:14 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Deleted volume successfully. Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58dc4f96-b579-46ef-9598-b65696beb959 tempest-VolumesTransfersV357Test-202817962 None] Lock "cinder-66fbd28b-7f52-46bb-9ed7-89d54a724e9e-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Flow 'volume_create_manager' (24fdc1a7-5d4b-4157-975d-27e558f40f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbe2ae1-8e46-4c87-aff2-0e16f7cb5085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbe2ae1-8e46-4c87-aff2-0e16f7cb5085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-463973371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5d45fd-90da-4d04-8a48-5df7179612f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda89517c7dd41ec89eb2622fab60d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:14Z,use_quota=True,user_id='77d5b5123a9d4b278b445f05050143b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb86c75-f0d2-4b25-8679-615bcd0fa6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb86c75-f0d2-4b25-8679-615bcd0fa6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e9e23c-6ff6-407f-8c9b-4e1d7c1e4c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e9e23c-6ff6-407f-8c9b-4e1d7c1e4c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5d45fd-90da-4d04-8a48-5df7179612f6', 'volume_name': 'volume-3b5d45fd-90da-4d04-8a48-5df7179612f6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f6e7f2-c315-4645-bf00-2cfb232f0f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f6e7f2-c315-4645-bf00-2cfb232f0f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6cc298-16f7-4614-9276-3a5878a6e9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:14 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Volume 3b5d45fd-90da-4d04-8a48-5df7179612f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5d45fd-90da-4d04-8a48-5df7179612f6', 'volume_size': 1} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-463973371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5d45fd-90da-4d04-8a48-5df7179612f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda89517c7dd41ec89eb2622fab60d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:14Z,use_quota=True,user_id='77d5b5123a9d4b278b445f05050143b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Creating volume 3b5d45fd-90da-4d04-8a48-5df7179612f6 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:14 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:14 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 1073741824 Sep 30 19:44:14 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:15 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 1073741824" returned: 0 in 0.736s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:15 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 Sep 30 19:44:15 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:15 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6" returned: 0 in 0.331s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a6cc298-16f7-4614-9276-3a5878a6e9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5d45fd-90da-4d04-8a48-5df7179612f6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9918e0-0d82-4c4a-b787-6e69b693249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:15 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Volume volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 (3b5d45fd-90da-4d04-8a48-5df7179612f6): created successfully Sep 30 19:44:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9918e0-0d82-4c4a-b787-6e69b693249e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Flow 'volume_create_manager' (24fdc1a7-5d4b-4157-975d-27e558f40f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:15 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a1864264-a67f-41c3-9509-23d326ba5f60 tempest-VolumesTransfersV357Test-419884361 None] Created volume successfully. Sep 30 19:44:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Acquiring lock "cinder-3b5d45fd-90da-4d04-8a48-5df7179612f6-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Lock "cinder-3b5d45fd-90da-4d04-8a48-5df7179612f6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Acquiring lock "cinder-quobyte-3b5d45fd-90da-4d04-8a48-5df7179612f6" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Lock "cinder-quobyte-3b5d45fd-90da-4d04-8a48-5df7179612f6" acquired by "delete_volume" :: waited 0.046s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:17 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[85efc17b-f91a-4da1-a998-02085910a87f]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:44:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:17 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 Sep 30 19:44:17 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:17 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6" returned: 0 in 0.513s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:17 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6 Sep 30 19:44:17 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:18 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3b5d45fd-90da-4d04-8a48-5df7179612f6" returned: 0 in 0.283s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Lock "cinder-quobyte-3b5d45fd-90da-4d04-8a48-5df7179612f6" released by "delete_volume" :: held 0.886s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Created reservations ['b19f8629-1f7a-4702-87b0-98df587efee4', '5f1a49a8-3226-49e8-9a9a-04ea95fd17fc', 'd2979266-a39e-4d2d-bb62-bef59d209ce4', '15870d99-6bbc-4b99-8376-7dd71e4bb061'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:18 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:44:18 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:18 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.411s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:44:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Deleted volume successfully. Sep 30 19:44:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a040c689-a06a-4a6f-a13a-484d5689a35b tempest-VolumesTransfersV357Test-202817962 None] Lock "cinder-3b5d45fd-90da-4d04-8a48-5df7179612f6-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-53a87432-062d-4625-bff9-cf4f6fb6f854 req-21645541-a905-48ee-ad2c-b44389bc12ae tempest-AttachVolumeNegativeTest-1406576198 None] Terminate volume connection completed successfully. Sep 30 19:44:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-53a87432-062d-4625-bff9-cf4f6fb6f854 req-21645541-a905-48ee-ad2c-b44389bc12ae tempest-AttachVolumeNegativeTest-1406576198 None] Deleting attachment a77365e3-2ad6-434e-8325-16711e5e2159. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:44:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:44:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:23 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:44:23 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:24 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:44:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:44:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:44:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:44:28 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=39,cinder:SELECT=23,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:44:30 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=20,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Flow 'volume_create_manager' (3de6f7a7-45fa-463d-9bcd-a17ed3bc7d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3be987f-a784-4656-a63b-958392e3afad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3be987f-a784-4656-a63b-958392e3afad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1960893762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e51bcf1-73f4-4894-b2b2-a81e60a9d069,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42d5651f3a8f449abc0f24685bf53c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:37Z,use_quota=True,user_id='0902d4e1e3af4558bd8313e278974c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb350d4a-3930-4ca2-9900-fb7942f0333b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb350d4a-3930-4ca2-9900-fb7942f0333b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec6b684-c784-4500-9e76-04d7766598a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec6b684-c784-4500-9e76-04d7766598a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e51bcf1-73f4-4894-b2b2-a81e60a9d069', 'volume_name': 'volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d6e8fa-5ef9-4cfd-8756-6d77a01409da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d6e8fa-5ef9-4cfd-8756-6d77a01409da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147d99b2-9d2c-4e39-ae51-e7ff6933a9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:36 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Volume 9e51bcf1-73f4-4894-b2b2-a81e60a9d069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069', 'volume_size': 1} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1960893762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e51bcf1-73f4-4894-b2b2-a81e60a9d069,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42d5651f3a8f449abc0f24685bf53c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:37Z,use_quota=True,user_id='0902d4e1e3af4558bd8313e278974c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Creating volume 9e51bcf1-73f4-4894-b2b2-a81e60a9d069 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:36 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:36 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 1073741824 Sep 30 19:44:36 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:37 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 1073741824" returned: 0 in 0.597s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:37 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 Sep 30 19:44:37 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:37 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069" returned: 0 in 0.401s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147d99b2-9d2c-4e39-ae51-e7ff6933a9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f21ba59-3f0b-46fc-9e4e-3ac9dee58d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:38 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Volume volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 (9e51bcf1-73f4-4894-b2b2-a81e60a9d069): created successfully Sep 30 19:44:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f21ba59-3f0b-46fc-9e4e-3ac9dee58d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Flow 'volume_create_manager' (3de6f7a7-45fa-463d-9bcd-a17ed3bc7d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:38 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-712c4405-0f4a-4960-a531-ed71b4718073 tempest-VolumesListTestJSON-29444985 None] Created volume successfully. Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Flow 'volume_create_manager' (b607c5b0-9cc0-4391-8d37-93a0acbb459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02bd953-3ac1-4151-8ed4-a09a8e951720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02bd953-3ac1-4151-8ed4-a09a8e951720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-898857539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3090567a-0ad9-491e-a8bf-52fe71dc57fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597d9cc486b84b6fb5549255e14b6d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:39Z,use_quota=True,user_id='1aab72016aca4d9b8b9907c6057eec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c35766-2b2c-45e6-8daa-ee1cd47f3530),volume_type_id=c7c35766-2b2c-45e6-8daa-ee1cd47f3530)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8999a9-86be-463a-8712-f9abd1253886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8999a9-86be-463a-8712-f9abd1253886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48df33b4-7f4e-4705-9e95-3fa33e9b3fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48df33b4-7f4e-4705-9e95-3fa33e9b3fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3090567a-0ad9-491e-a8bf-52fe71dc57fb', 'volume_name': 'volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72732aa-60f7-4521-9de7-d81d47398a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72732aa-60f7-4521-9de7-d81d47398a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc199bb9-621a-4034-bd79-e90701aaecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:39 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Volume 3090567a-0ad9-491e-a8bf-52fe71dc57fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb', 'volume_size': 1} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-898857539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3090567a-0ad9-491e-a8bf-52fe71dc57fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597d9cc486b84b6fb5549255e14b6d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:39Z,use_quota=True,user_id='1aab72016aca4d9b8b9907c6057eec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c35766-2b2c-45e6-8daa-ee1cd47f3530),volume_type_id=c7c35766-2b2c-45e6-8daa-ee1cd47f3530)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Creating volume 3090567a-0ad9-491e-a8bf-52fe71dc57fb {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:39 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:39 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb 1073741824 Sep 30 19:44:39 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:40 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb 1073741824" returned: 0 in 0.750s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:40 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb Sep 30 19:44:40 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Flow 'volume_create_manager' (1a04dfe0-2060-46f4-ad51-94499d684345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698d8ba5-f9be-4489-8828-b0a9d2857452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698d8ba5-f9be-4489-8828-b0a9d2857452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1164784176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ebdf23-1602-4de3-a706-4d1ecfac24b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597d9cc486b84b6fb5549255e14b6d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:40Z,use_quota=True,user_id='1aab72016aca4d9b8b9907c6057eec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e47946f-2053-404b-8325-e8b74865c5b4),volume_type_id=7e47946f-2053-404b-8325-e8b74865c5b4)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5492741f-fc3f-475a-855c-942f22bf0783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5492741f-fc3f-475a-855c-942f22bf0783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57907a4-88cd-4249-af19-8d29e557b2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57907a4-88cd-4249-af19-8d29e557b2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ebdf23-1602-4de3-a706-4d1ecfac24b4', 'volume_name': 'volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607b7fa4-4d8f-407b-b8e8-01c17bcfba4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607b7fa4-4d8f-407b-b8e8-01c17bcfba4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5948c758-e43b-4c8b-860c-046dd8a1f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Volume 37ebdf23-1602-4de3-a706-4d1ecfac24b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4', 'volume_size': 1} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:40 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Flow 'volume_create_manager' (15fa332a-a175-473a-880e-9c2d8879bd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20adba19-ec68-40c2-a88d-ea3188b29049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb" returned: 0 in 0.367s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.053s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1164784176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ebdf23-1602-4de3-a706-4d1ecfac24b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597d9cc486b84b6fb5549255e14b6d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:40Z,use_quota=True,user_id='1aab72016aca4d9b8b9907c6057eec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e47946f-2053-404b-8325-e8b74865c5b4),volume_type_id=7e47946f-2053-404b-8325-e8b74865c5b4)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Creating volume 37ebdf23-1602-4de3-a706-4d1ecfac24b4 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:40 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20adba19-ec68-40c2-a88d-ea3188b29049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-290824139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a48f95-31cf-468c-ac09-f3865111619f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42d5651f3a8f449abc0f24685bf53c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:40Z,use_quota=True,user_id='0902d4e1e3af4558bd8313e278974c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 1073741824 Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd35673-4cb0-4cdd-bf34-0e894694c832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd35673-4cb0-4cdd-bf34-0e894694c832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed4ba50-c45e-4450-93bf-e997f0ed4de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed4ba50-c45e-4450-93bf-e997f0ed4de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a48f95-31cf-468c-ac09-f3865111619f', 'volume_name': 'volume-42a48f95-31cf-468c-ac09-f3865111619f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4d9358-3431-4240-a6c0-be44093cbff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4d9358-3431-4240-a6c0-be44093cbff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90819fe3-129f-4e6c-9a41-8e6b7e36ca2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Volume 42a48f95-31cf-468c-ac09-f3865111619f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a48f95-31cf-468c-ac09-f3865111619f', 'volume_size': 1} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc199bb9-621a-4034-bd79-e90701aaecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ad8015-46f9-47f5-b219-ed71bbfeca4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:40 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Volume volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb (3090567a-0ad9-491e-a8bf-52fe71dc57fb): created successfully Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ad8015-46f9-47f5-b219-ed71bbfeca4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Flow 'volume_create_manager' (b607c5b0-9cc0-4391-8d37-93a0acbb459a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:40 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3c39591a-bd15-4964-93f1-260e798ed8c1 tempest-TestInstancesWithCinderVolumes-1503083992 None] Created volume successfully. Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Flow 'volume_create_manager' (ef3ba50e-c0de-46ce-be78-f79b8ac95157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8631fe-6090-4ff3-8c73-ad9ae810be0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8631fe-6090-4ff3-8c73-ad9ae810be0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-459980272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a088578-b406-4ae4-a62d-b30f683f0baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597d9cc486b84b6fb5549255e14b6d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:41Z,use_quota=True,user_id='1aab72016aca4d9b8b9907c6057eec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b07228a0-b9fa-48b5-81cf-3dde6bd63f55),volume_type_id=b07228a0-b9fa-48b5-81cf-3dde6bd63f55)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a2d116-63f0-43b6-8d76-dd80d7043399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a2d116-63f0-43b6-8d76-dd80d7043399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c327899-a15f-47c5-b4e4-e85549a765cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:44:41 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 1073741824" returned: 0 in 0.665s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:41 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 Sep 30 19:44:41 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c327899-a15f-47c5-b4e4-e85549a765cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a088578-b406-4ae4-a62d-b30f683f0baa', 'volume_name': 'volume-5a088578-b406-4ae4-a62d-b30f683f0baa', 'volume_size': 1, 'image_id': '3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1232352985', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '597d9cc486b84b6fb5549255e14b6d7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'created_at': datetime.datetime(2026, 9, 30, 17, 44, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 44, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a/file', 'properties': {}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6634cf62-84e3-4c44-b67b-14cff9d53cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6634cf62-84e3-4c44-b67b-14cff9d53cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f56739-3c5d-4ae8-be25-d0adc8547c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:41 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Volume 5a088578-b406-4ae4-a62d-b30f683f0baa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a088578-b406-4ae4-a62d-b30f683f0baa', 'volume_size': 1, 'image_id': '3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1232352985', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '597d9cc486b84b6fb5549255e14b6d7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'created_at': datetime.datetime(2026, 9, 30, 17, 44, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 44, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a/file', 'properties': {}}, 'image_service': } Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Trying to clone 5a088578-b406-4ae4-a62d-b30f683f0baa from image 3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:44:41 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4" returned: 0 in 0.433s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-290824139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a48f95-31cf-468c-ac09-f3865111619f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42d5651f3a8f449abc0f24685bf53c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:40Z,use_quota=True,user_id='0902d4e1e3af4558bd8313e278974c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Creating volume 42a48f95-31cf-468c-ac09-f3865111619f {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:41 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5948c758-e43b-4c8b-860c-046dd8a1f27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f574bfd3-c16d-4c25-8e8d-23f4ac573a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:41 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f 1073741824 Sep 30 19:44:41 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:41 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Volume volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 (37ebdf23-1602-4de3-a706-4d1ecfac24b4): created successfully Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f574bfd3-c16d-4c25-8e8d-23f4ac573a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Flow 'volume_create_manager' (1a04dfe0-2060-46f4-ad51-94499d684345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:41 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-50797c90-38da-4852-9a73-39f73976cc23 tempest-TestInstancesWithCinderVolumes-1503083992 None] Created volume successfully. Sep 30 19:44:42 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f 1073741824" returned: 0 in 0.743s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:42 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f Sep 30 19:44:42 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:42 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f" returned: 0 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90819fe3-129f-4e6c-9a41-8e6b7e36ca2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a48f95-31cf-468c-ac09-f3865111619f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f224af44-78f7-4e8a-921c-61a66c984307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:42 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Volume volume-42a48f95-31cf-468c-ac09-f3865111619f (42a48f95-31cf-468c-ac09-f3865111619f): created successfully Sep 30 19:44:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f224af44-78f7-4e8a-921c-61a66c984307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Flow 'volume_create_manager' (15fa332a-a175-473a-880e-9c2d8879bd16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8f6edbb0-3875-4b3d-82e5-c37ba0072ba4 tempest-VolumesListTestJSON-29444985 None] Created volume successfully. Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Flow 'volume_create_manager' (a595e291-e1ef-4bb3-a27f-8b399035b334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d25c62b-e653-4945-b3c2-b504d547b306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d25c62b-e653-4945-b3c2-b504d547b306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1521577387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a567c8d6-b596-431e-9057-af7f2a984441,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42d5651f3a8f449abc0f24685bf53c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:44Z,use_quota=True,user_id='0902d4e1e3af4558bd8313e278974c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55fdaa51-0f5c-41aa-91f6-34decfd33f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55fdaa51-0f5c-41aa-91f6-34decfd33f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af390e3c-c6d2-41e6-ac2c-b805a1312c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af390e3c-c6d2-41e6-ac2c-b805a1312c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a567c8d6-b596-431e-9057-af7f2a984441', 'volume_name': 'volume-a567c8d6-b596-431e-9057-af7f2a984441', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65670d2b-560d-4c49-9d25-c342e93f21b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65670d2b-560d-4c49-9d25-c342e93f21b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fbd44b-88fa-458b-aa4f-ffeeb42a7ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:44 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Volume a567c8d6-b596-431e-9057-af7f2a984441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a567c8d6-b596-431e-9057-af7f2a984441', 'volume_size': 1} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1521577387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a567c8d6-b596-431e-9057-af7f2a984441,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42d5651f3a8f449abc0f24685bf53c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:44Z,use_quota=True,user_id='0902d4e1e3af4558bd8313e278974c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Creating volume a567c8d6-b596-431e-9057-af7f2a984441 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:44 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:44 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441 1073741824 Sep 30 19:44:44 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:44 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441 1073741824" returned: 0 in 0.636s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:44 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441 Sep 30 19:44:44 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:45 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441" returned: 0 in 0.452s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fbd44b-88fa-458b-aa4f-ffeeb42a7ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a567c8d6-b596-431e-9057-af7f2a984441', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93d8cbb-2bd8-4a89-bf10-187a7705b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:45 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Volume volume-a567c8d6-b596-431e-9057-af7f2a984441 (a567c8d6-b596-431e-9057-af7f2a984441): created successfully Sep 30 19:44:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93d8cbb-2bd8-4a89-bf10-187a7705b31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Flow 'volume_create_manager' (a595e291-e1ef-4bb3-a27f-8b399035b334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-33375731-919c-40eb-a28b-43f30e78fbbd tempest-VolumesListTestJSON-29444985 None] Created volume successfully. Sep 30 19:44:47 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD, size 20.69 MB, duration 5.95 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:44:47 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Image download 20.69 MB at 3.47 MB/s Sep 30 19:44:47 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae581a6e-45b5-4c25-bb98-86c118bbb646]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:44:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:47 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD Sep 30 19:44:47 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:47 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:47 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Temporary image 3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a is fetched for user 1aab72016aca4d9b8b9907c6057eec89. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aed55c8-13a1-47c8-9164-73d86420f6d8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:48 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD Sep 30 19:44:48 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:48 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-459980272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a088578-b406-4ae4-a62d-b30f683f0baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597d9cc486b84b6fb5549255e14b6d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:41Z,use_quota=True,user_id='1aab72016aca4d9b8b9907c6057eec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b07228a0-b9fa-48b5-81cf-3dde6bd63f55),volume_type_id=b07228a0-b9fa-48b5-81cf-3dde6bd63f55)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Creating volume 5a088578-b406-4ae4-a62d-b30f683f0baa {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:48 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:48 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa 1073741824 Sep 30 19:44:48 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:49 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa 1073741824" returned: 0 in 0.781s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:49 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa Sep 30 19:44:49 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:49 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa" returned: 0 in 0.456s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:49 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Attempting download of 3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'metadata': {}}])) to volume 5a088578-b406-4ae4-a62d-b30f683f0baa. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[88720471-5b45-4c73-bd0c-8bd1aab4dc6d]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_rea0ndbk {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:50 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_rea0ndbk Sep 30 19:44:50 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Acquiring lock "cinder-a567c8d6-b596-431e-9057-af7f2a984441-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Lock "cinder-a567c8d6-b596-431e-9057-af7f2a984441-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:50 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_rea0ndbk" returned: 0 in 0.650s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_rea0ndbk {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Acquiring lock "cinder-quobyte-a567c8d6-b596-431e-9057-af7f2a984441" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Lock "cinder-quobyte-a567c8d6-b596-431e-9057-af7f2a984441" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d373a-cd25-4fb9-93e5-c55d601048ca]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:44:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:50 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_rea0ndbk Sep 30 19:44:50 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:50 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441 Sep 30 19:44:50 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:51 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_rea0ndbk" returned: 1 in 0.546s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_rea0ndbk' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb842c6-691c-4178-8cdf-af687a5b380c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:51 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441" returned: 0 in 0.556s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:51 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441 Sep 30 19:44:51 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:51 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD Sep 30 19:44:51 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:51 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD" returned: 0 in 0.551s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] 3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a was qcow2, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:51 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa Sep 30 19:44:51 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:51 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a567c8d6-b596-431e-9057-af7f2a984441" returned: 0 in 0.563s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Lock "cinder-quobyte-a567c8d6-b596-431e-9057-af7f2a984441" released by "delete_volume" :: held 1.209s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Created reservations ['58af5e10-41d8-4dcd-bc0e-ed395905f3a0', '52d65856-3799-4104-84fa-ade4d6fc33cc', '63f1f3d7-2505-445c-9114-b2af52cd2d5e', 'e08bd538-a583-4823-bd40-70aa8d9c9062'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:52 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:44:52 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:52 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.447s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:44:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Deleted volume successfully. Sep 30 19:44:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc427d2d-191f-4af5-964b-8ecbd1a958ff tempest-VolumesListTestJSON-29444985 None] Lock "cinder-a567c8d6-b596-431e-9057-af7f2a984441-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Acquiring lock "cinder-42a48f95-31cf-468c-ac09-f3865111619f-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Lock "cinder-42a48f95-31cf-468c-ac09-f3865111619f-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Acquiring lock "cinder-quobyte-42a48f95-31cf-468c-ac09-f3865111619f" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Lock "cinder-quobyte-42a48f95-31cf-468c-ac09-f3865111619f" acquired by "delete_volume" :: waited 0.046s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:53 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[de877b16-01e2-4530-af07-05ff9986a2c3]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:44:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:53 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f Sep 30 19:44:53 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:54 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f" returned: 0 in 0.709s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:54 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f Sep 30 19:44:54 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:54 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-42a48f95-31cf-468c-ac09-f3865111619f" returned: 0 in 0.533s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Lock "cinder-quobyte-42a48f95-31cf-468c-ac09-f3865111619f" released by "delete_volume" :: held 1.327s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:54 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Created reservations ['0fdf1faf-8ef4-42ff-86b9-32e891dfb04e', '0c29be5e-b2b0-4a6a-a03f-c8668bc0a15e', '1c20543f-71fd-4097-a918-ee05f50b903f', 'ab9dd29d-cec6-40c1-b907-47b100e068ac'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:44:54 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa" returned: 0 in 3.134s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:54 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a_btckw9d6devstack@QuobyteHD, size 112.00 MB, duration 3.13 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:44:54 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Converted 112.00 MB image at 35.73 MB/s Sep 30 19:44:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:55 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa 1G Sep 30 19:44:55 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:55 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:44:55 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:55 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.394s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:44:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Deleted volume successfully. Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-113ab97b-6bb7-40b8-83a6-47ede8552125 tempest-VolumesListTestJSON-29444985 None] Lock "cinder-42a48f95-31cf-468c-ac09-f3865111619f-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:55 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa 1G" returned: 0 in 0.621s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Downloaded image 3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'metadata': {}}])) to volume 5a088578-b406-4ae4-a62d-b30f683f0baa successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Temporary image 3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a for user 1aab72016aca4d9b8b9907c6057eec89 is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Marking volume 5a088578-b406-4ae4-a62d-b30f683f0baa as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Copying metadata from image 3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a to 5a088578-b406-4ae4-a62d-b30f683f0baa. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Creating volume glance metadata for volume 5a088578-b406-4ae4-a62d-b30f683f0baa backed by image 3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a with: {'image_id': '3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'image_name': 'tempest-scenario-img--1232352985', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Acquiring lock "cinder-9e51bcf1-73f4-4894-b2b2-a81e60a9d069-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Lock "cinder-9e51bcf1-73f4-4894-b2b2-a81e60a9d069-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f56739-3c5d-4ae8-be25-d0adc8547c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a088578-b406-4ae4-a62d-b30f683f0baa', 'volume_size': 1, 'image_id': '3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1232352985', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '597d9cc486b84b6fb5549255e14b6d7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a', 'created_at': datetime.datetime(2026, 9, 30, 17, 44, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 44, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d4abc4f-8e8b-4a4e-935f-2a064b66ee3a/file', 'properties': {}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55ad2aa-f7f6-4a19-ab88-7d3376216a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Acquiring lock "cinder-quobyte-9e51bcf1-73f4-4894-b2b2-a81e60a9d069" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:44:55 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Volume volume-5a088578-b406-4ae4-a62d-b30f683f0baa (5a088578-b406-4ae4-a62d-b30f683f0baa): created successfully Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55ad2aa-f7f6-4a19-ab88-7d3376216a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Flow 'volume_create_manager' (ef3ba50e-c0de-46ce-be78-f79b8ac95157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3e5b3031-bbe9-4e41-9654-f581608a05ea tempest-TestInstancesWithCinderVolumes-1503083992 None] Created volume successfully. Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Lock "cinder-quobyte-9e51bcf1-73f4-4894-b2b2-a81e60a9d069" acquired by "delete_volume" :: waited 0.047s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c847a95-127c-4415-a8f3-3a9f63239aa9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:44:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:56 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 Sep 30 19:44:56 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Flow 'volume_create_manager' (e48ab48f-cbe1-44d2-88a6-7e81c1cdbd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4448345b-56ac-42ce-b67a-25faa0f0c3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4448345b-56ac-42ce-b67a-25faa0f0c3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1106609868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69adc2ceb16418a8a8bdc5c48962020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:56Z,use_quota=True,user_id='e12e42cf05754029a756830cc0b0a4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c9a8ce-c8b9-4c47-8c73-71746b867570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c9a8ce-c8b9-4c47-8c73-71746b867570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9204e585-fdb0-4ee0-9620-88ffcfc35fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9204e585-fdb0-4ee0-9620-88ffcfc35fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f', 'volume_name': 'volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca19e508-c76c-44bf-a2a1-3b24c36ef5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca19e508-c76c-44bf-a2a1-3b24c36ef5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffa6f8b-25b4-4c02-b767-b5f6aed9c8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Volume cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f', 'volume_size': 1} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1106609868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69adc2ceb16418a8a8bdc5c48962020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:56Z,use_quota=True,user_id='e12e42cf05754029a756830cc0b0a4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Creating volume cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:56 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:56 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f 1073741824 Sep 30 19:44:56 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:56 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069" returned: 0 in 0.604s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:56 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069 Sep 30 19:44:56 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Flow 'volume_create_manager' (0dd21393-0d73-4e39-9cc6-5698be92ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f29c81-6700-4b15-b61f-927dc1cce027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f29c81-6700-4b15-b61f-927dc1cce027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1604006380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af934e42-f4a7-4176-b074-364acb0b0c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69adc2ceb16418a8a8bdc5c48962020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:56Z,use_quota=True,user_id='e12e42cf05754029a756830cc0b0a4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b9c8a5-18ae-432e-8fdc-e22e44a989ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b9c8a5-18ae-432e-8fdc-e22e44a989ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e423c09b-7840-4890-a72d-ab74b99db8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e423c09b-7840-4890-a72d-ab74b99db8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af934e42-f4a7-4176-b074-364acb0b0c24', 'volume_name': 'volume-af934e42-f4a7-4176-b074-364acb0b0c24', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200d7983-d1f6-49ac-b7f3-73e4c6ce7027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200d7983-d1f6-49ac-b7f3-73e4c6ce7027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141ab0d7-5617-44cd-8b10-ca1c8d5f3345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Volume af934e42-f4a7-4176-b074-364acb0b0c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af934e42-f4a7-4176-b074-364acb0b0c24', 'volume_size': 1} Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:56 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9e51bcf1-73f4-4894-b2b2-a81e60a9d069" returned: 0 in 0.446s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Lock "cinder-quobyte-9e51bcf1-73f4-4894-b2b2-a81e60a9d069" released by "delete_volume" :: held 1.120s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Created reservations ['34ac8455-6408-4886-999c-c32ac6443ad2', '3e7240d8-e2e6-4b39-b3f5-4d3eb826c1ac', '02fc80c2-1b99-4357-82a7-098a52f2815e', '9d892b08-c7f2-41e5-9204-a9d7f869a7d5'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:57 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f 1073741824" returned: 0 in 0.944s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:57 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:44:57 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:57 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f Sep 30 19:44:57 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:57 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.440s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:44:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Deleted volume successfully. Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0ed76b9d-eda2-4282-9135-d57ba371090f tempest-VolumesListTestJSON-29444985 None] Lock "cinder-9e51bcf1-73f4-4894-b2b2-a81e60a9d069-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:44:57 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f" returned: 0 in 0.419s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.016s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1604006380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af934e42-f4a7-4176-b074-364acb0b0c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b69adc2ceb16418a8a8bdc5c48962020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:44:56Z,use_quota=True,user_id='e12e42cf05754029a756830cc0b0a4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Creating volume af934e42-f4a7-4176-b074-364acb0b0c24 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:44:57 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffa6f8b-25b4-4c02-b767-b5f6aed9c8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0cb36c-abdd-4cc3-acaa-c2b778c4e71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:57 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24 1073741824 Sep 30 19:44:57 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Volume volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f (cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f): created successfully Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0cb36c-abdd-4cc3-acaa-c2b778c4e71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Flow 'volume_create_manager' (e48ab48f-cbe1-44d2-88a6-7e81c1cdbd5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7fd25d8b-b185-4c38-b05f-bc8fd27e6e4d tempest-TestServerVolumeAttachmentScenario-305932398 None] Created volume successfully. Sep 30 19:44:58 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24 1073741824" returned: 0 in 0.799s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:44:58 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24 Sep 30 19:44:58 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:44:59 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 30 19:44:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24" returned: 0 in 0.469s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:44:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:44:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:44:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141ab0d7-5617-44cd-8b10-ca1c8d5f3345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af934e42-f4a7-4176-b074-364acb0b0c24', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c18feb0-d9fe-48e1-8528-4e4f064941bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:44:59 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Volume volume-af934e42-f4a7-4176-b074-364acb0b0c24 (af934e42-f4a7-4176-b074-364acb0b0c24): created successfully Sep 30 19:44:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c18feb0-d9fe-48e1-8528-4e4f064941bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:44:59 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Flow 'volume_create_manager' (0dd21393-0d73-4e39-9cc6-5698be92ec71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:44:59 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0c4fa7cb-8e6f-4f24-ba03-3899437d50a0 tempest-TestServerVolumeAttachmentScenario-305932398 None] Created volume successfully. Sep 30 19:45:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-ead76f0b-add2-42ce-8142-83ead348a8e9 req-80c96b90-8f1f-4f11-abb1-b192d01b2286 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-ead76f0b-add2-42ce-8142-83ead348a8e9 req-80c96b90-8f1f-4f11-abb1-b192d01b2286 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-ead76f0b-add2-42ce-8142-83ead348a8e9 req-80c96b90-8f1f-4f11-abb1-b192d01b2286 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-ead76f0b-add2-42ce-8142-83ead348a8e9 req-80c96b90-8f1f-4f11-abb1-b192d01b2286 tempest-TestInstancesWithCinderVolumes-1503083992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-5a088578-b406-4ae4-a62d-b30f683f0baa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23e38018-0781-4a35-a012-f6b4890ca24f', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:45:01 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-ead76f0b-add2-42ce-8142-83ead348a8e9 req-80c96b90-8f1f-4f11-abb1-b192d01b2286 tempest-TestInstancesWithCinderVolumes-1503083992 None] attachment_update completed successfully. Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Flow 'volume_create_manager' (4947c9ea-7d4c-494e-9a7a-687626cfc4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a78722d-d688-476b-80e9-85aef70f75f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a78722d-d688-476b-80e9-85aef70f75f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-864033428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b92b38-2b9e-4fd4-8fd5-80433d72884b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c340b87f49443abb238b72a8d0a3f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:45:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:45:05Z,use_quota=True,user_id='0329496faf93468a8a497f409b05431c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb85be6-b152-467c-a0d2-677416ef86bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb85be6-b152-467c-a0d2-677416ef86bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c274ee63-e103-46e5-a973-a212c2064ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c274ee63-e103-46e5-a973-a212c2064ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b92b38-2b9e-4fd4-8fd5-80433d72884b', 'volume_name': 'volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b', 'volume_size': 2}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00afd8a-0515-415b-9a33-22ba28bcb821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00afd8a-0515-415b-9a33-22ba28bcb821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a18c7e-3297-4faa-b5d5-8af97e56833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:05 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Volume 36b92b38-2b9e-4fd4-8fd5-80433d72884b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b', 'volume_size': 2} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-864033428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b92b38-2b9e-4fd4-8fd5-80433d72884b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c340b87f49443abb238b72a8d0a3f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:45:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:45:05Z,use_quota=True,user_id='0329496faf93468a8a497f409b05431c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Creating volume 36b92b38-2b9e-4fd4-8fd5-80433d72884b {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:45:05 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:45:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b 2147483648 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:05 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b 2147483648 Sep 30 19:45:05 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:06 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b 2147483648" returned: 0 in 0.836s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:06 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b Sep 30 19:45:06 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:06 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b" returned: 0 in 0.312s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:45:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a18c7e-3297-4faa-b5d5-8af97e56833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b', 'volume_size': 2}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb03578-76f4-4223-a52f-33bc283ad617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:06 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Volume volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b (36b92b38-2b9e-4fd4-8fd5-80433d72884b): created successfully Sep 30 19:45:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb03578-76f4-4223-a52f-33bc283ad617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Flow 'volume_create_manager' (4947c9ea-7d4c-494e-9a7a-687626cfc4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:45:06 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b09d7747-438f-4264-a7d4-7e978047a942 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Created volume successfully. Sep 30 19:45:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Creating offline snapshot ab99d747-5bd6-4636-aed8-2075dfb19fff of volume 36b92b38-2b9e-4fd4-8fd5-80433d72884b {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:45:07 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20ac100-6806-4dc4-ae2f-ba436e3a7bf4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:45:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:08 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b Sep 30 19:45:08 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:09 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b" returned: 0 in 1.049s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff 2G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:09 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff 2G Sep 30 19:45:09 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:10 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff 2G" returned: 0 in 1.134s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:10 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff Sep 30 19:45:10 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:10 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff" returned: 0 in 0.399s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:10 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff is being set with open permissions: ugo+rw Sep 30 19:45:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:10 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff Sep 30 19:45:10 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:10 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff" returned: 0 in 0.352s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:11 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.info Sep 30 19:45:11 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:11 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.info" returned: 0 in 0.674s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:11 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.info is being set with open permissions: ugo+rw Sep 30 19:45:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:11 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.info Sep 30 19:45:11 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:12 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.info" returned: 0 in 0.442s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.326s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-daecbb30-149b-43ca-83ca-fd24837f976c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Create snapshot completed successfully Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Acquiring lock "cinder-ab99d747-5bd6-4636-aed8-2075dfb19fff-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-ab99d747-5bd6-4636-aed8-2075dfb19fff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Acquiring lock "cinder-quobyte-36b92b38-2b9e-4fd4-8fd5-80433d72884b" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-quobyte-36b92b38-2b9e-4fd4-8fd5-80433d72884b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Acquiring lock "cinder-quobyte-ab99d747-5bd6-4636-aed8-2075dfb19fff" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-quobyte-ab99d747-5bd6-4636-aed8-2075dfb19fff" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Deleting offline snapshot ab99d747-5bd6-4636-aed8-2075dfb19fff of volume 36b92b38-2b9e-4fd4-8fd5-80433d72884b {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] snapshot_file for this snap is: volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce6db51-4510-4f88-8801-8872520b06ad]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:45:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:13 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff Sep 30 19:45:13 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:14 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff" returned: 0 in 0.667s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:45:14 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[77662a05-5582-4a17-8139-ba640772f4c2]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:45:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:14 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b Sep 30 19:45:14 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:15 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b" returned: 0 in 1.154s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:15 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff Sep 30 19:45:15 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:15 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:45:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Flow 'volume_create_manager' (ad872356-38be-45cd-abec-65f8c32ad02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:45:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324e455c-c7b7-40ab-98fa-2147a3b16058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324e455c-c7b7-40ab-98fa-2147a3b16058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1291996600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c0ad21-bfb9-490e-b328-3bcd7ef9b54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6178139e3d4e18b52725b563f4bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:45:16Z,use_quota=True,user_id='a175b2c5dd964331a84360accf02f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc181fe-f3fb-4f99-b9c6-d7d898cb7ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc181fe-f3fb-4f99-b9c6-d7d898cb7ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ee3c84-c76b-4d20-9ba4-7b5a7516eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ee3c84-c76b-4d20-9ba4-7b5a7516eb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c0ad21-bfb9-490e-b328-3bcd7ef9b54e', 'volume_name': 'volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65858c1-7ef3-4aee-b2ae-b3787ebd2fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65858c1-7ef3-4aee-b2ae-b3787ebd2fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556171bb-5326-42ae-b16b-1856cca674b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:16 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Volume 93c0ad21-bfb9-490e-b328-3bcd7ef9b54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e', 'volume_size': 1} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1291996600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c0ad21-bfb9-490e-b328-3bcd7ef9b54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6178139e3d4e18b52725b563f4bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:45:16Z,use_quota=True,user_id='a175b2c5dd964331a84360accf02f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Creating volume 93c0ad21-bfb9-490e-b328-3bcd7ef9b54e {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:45:16 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:16 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e 1073741824 Sep 30 19:45:16 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:16 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff" returned: 0 in 1.113s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:16 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff Sep 30 19:45:16 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:17 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e 1073741824" returned: 0 in 1.073s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:17 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e Sep 30 19:45:17 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:17 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b.ab99d747-5bd6-4636-aed8-2075dfb19fff" returned: 0 in 0.659s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-quobyte-ab99d747-5bd6-4636-aed8-2075dfb19fff" released by "_delete_snapshot" :: held 3.882s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:45:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-quobyte-36b92b38-2b9e-4fd4-8fd5-80433d72884b" released by "delete_snapshot" :: held 3.936s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:45:17 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Created reservations ['daa34c69-fa85-4635-9a8e-ec0baa6ae580', '253409b5-3522-459d-8a0b-8efb3a9afa6a', 'ab72e2a3-ece9-4839-8ebe-38b9b6a4f332', 'd554d3b3-14c9-4283-8d31-6cf2f7231ddf'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:45:17 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Delete snapshot completed successfully. Sep 30 19:45:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f7a12a1e-4954-4d57-8f46-e9c58456bdc0 tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-ab99d747-5bd6-4636-aed8-2075dfb19fff-delete_snapshot" released by "delete_snapshot" :: held 4.170s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:45:18 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e" returned: 0 in 0.797s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556171bb-5326-42ae-b16b-1856cca674b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc22595c-7e06-492e-9762-e86ec5b6972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:45:18 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Volume volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e (93c0ad21-bfb9-490e-b328-3bcd7ef9b54e): created successfully Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc22595c-7e06-492e-9762-e86ec5b6972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Flow 'volume_create_manager' (ad872356-38be-45cd-abec-65f8c32ad02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:45:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b3de07c4-fe6b-44de-a20c-b5383435eb9d tempest-AttachVolumeNegativeTest-1406576198 None] Created volume successfully. Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Acquiring lock "cinder-36b92b38-2b9e-4fd4-8fd5-80433d72884b-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-36b92b38-2b9e-4fd4-8fd5-80433d72884b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Acquiring lock "cinder-quobyte-36b92b38-2b9e-4fd4-8fd5-80433d72884b" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-quobyte-36b92b38-2b9e-4fd4-8fd5-80433d72884b" acquired by "delete_volume" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b21cee4-9ac4-4a4f-bc92-a6a072db3669]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:45:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:19 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b Sep 30 19:45:19 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:19 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b" returned: 0 in 0.938s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:19 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b Sep 30 19:45:19 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:20 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-36b92b38-2b9e-4fd4-8fd5-80433d72884b" returned: 0 in 0.755s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-quobyte-36b92b38-2b9e-4fd4-8fd5-80433d72884b" released by "delete_volume" :: held 1.890s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:45:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-d6ef8de2-c70e-4c55-97da-3dde028b77b8 req-e4277d49-63bd-49b5-8431-c0105299316e tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-d6ef8de2-c70e-4c55-97da-3dde028b77b8 req-e4277d49-63bd-49b5-8431-c0105299316e tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-d6ef8de2-c70e-4c55-97da-3dde028b77b8 req-e4277d49-63bd-49b5-8431-c0105299316e tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-d6ef8de2-c70e-4c55-97da-3dde028b77b8 req-e4277d49-63bd-49b5-8431-c0105299316e tempest-AttachVolumeNegativeTest-1406576198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89914a3b-2a15-408f-861c-f8f3bbea51f4', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:45:20 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Created reservations ['9f4d850d-c643-49a5-82de-2f422b48f53a', '3267516f-7a8b-4579-9d3e-34f5d930da59', '9b52e859-9080-4a6d-81c0-cab9fe232468', 'b07895aa-0d9f-4198-8e5c-adaeae34a6cc'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:45:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-d6ef8de2-c70e-4c55-97da-3dde028b77b8 req-e4277d49-63bd-49b5-8431-c0105299316e tempest-AttachVolumeNegativeTest-1406576198 None] attachment_update completed successfully. Sep 30 19:45:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:45:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:45:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:21 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:45:21 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:21 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.638s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:21 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:45:21 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Deleted volume successfully. Sep 30 19:45:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7a5bdc3-b754-4f98-be17-8971f4470b8c tempest-VolumesSnapshotNegativeTestJSON-1780508890 None] Lock "cinder-36b92b38-2b9e-4fd4-8fd5-80433d72884b-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:45:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:45:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:45:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:45:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:24 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:45:24 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:24 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-1298a8ac-a1d6-4bc0-96a1-85accb5627d6 req-153b116d-3c91-4703-a0fe-34a0503f84c0 tempest-AttachVolumeNegativeTest-1406576198 None] Terminate volume connection completed successfully. Sep 30 19:45:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-1298a8ac-a1d6-4bc0-96a1-85accb5627d6 req-153b116d-3c91-4703-a0fe-34a0503f84c0 tempest-AttachVolumeNegativeTest-1406576198 None] Deleting attachment 89914a3b-2a15-408f-861c-f8f3bbea51f4. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:45:24 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.786s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:45:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:45:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:45:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:45:31 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=81,cinder:SELECT=72,cinder:DELETE=10,cinder:INSERT=16 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:45:34 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=69,cinder:INSERT=24,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:45:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-02e9e00a-8858-4f66-9157-3fc3b0249f2c req-492cfcce-b556-4625-9210-c04f629309ef tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-02e9e00a-8858-4f66-9157-3fc3b0249f2c req-492cfcce-b556-4625-9210-c04f629309ef tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-02e9e00a-8858-4f66-9157-3fc3b0249f2c req-492cfcce-b556-4625-9210-c04f629309ef tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-02e9e00a-8858-4f66-9157-3fc3b0249f2c req-492cfcce-b556-4625-9210-c04f629309ef tempest-TestServerVolumeAttachmentScenario-305932398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '767ac091-77df-4897-9832-5ca33e308727', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:45:40 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-02e9e00a-8858-4f66-9157-3fc3b0249f2c req-492cfcce-b556-4625-9210-c04f629309ef tempest-TestServerVolumeAttachmentScenario-305932398 None] attachment_update completed successfully. Sep 30 19:45:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-16101371-94d3-4b89-a1c3-d0380d55e247 req-9f35a1f1-83af-4ed3-b9e5-0f29629eaad6 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-16101371-94d3-4b89-a1c3-d0380d55e247 req-9f35a1f1-83af-4ed3-b9e5-0f29629eaad6 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-16101371-94d3-4b89-a1c3-d0380d55e247 req-9f35a1f1-83af-4ed3-b9e5-0f29629eaad6 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-16101371-94d3-4b89-a1c3-d0380d55e247 req-9f35a1f1-83af-4ed3-b9e5-0f29629eaad6 tempest-TestInstancesWithCinderVolumes-1503083992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '183561f6-475c-427e-b2bf-0cc39e6edd65', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:45:47 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-16101371-94d3-4b89-a1c3-d0380d55e247 req-9f35a1f1-83af-4ed3-b9e5-0f29629eaad6 tempest-TestInstancesWithCinderVolumes-1503083992 None] attachment_update completed successfully. Sep 30 19:45:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-bc673cd6-19c4-4b48-8452-1e2150d845e4 req-ad969741-1e1d-4fdb-9adc-cd3def57dcc5 tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-bc673cd6-19c4-4b48-8452-1e2150d845e4 req-ad969741-1e1d-4fdb-9adc-cd3def57dcc5 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-bc673cd6-19c4-4b48-8452-1e2150d845e4 req-ad969741-1e1d-4fdb-9adc-cd3def57dcc5 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-bc673cd6-19c4-4b48-8452-1e2150d845e4 req-ad969741-1e1d-4fdb-9adc-cd3def57dcc5 tempest-TestServerVolumeAttachmentScenario-305932398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-af934e42-f4a7-4176-b074-364acb0b0c24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b76fcd50-7740-4030-9bf9-b9253ead77cd', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:45:47 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-bc673cd6-19c4-4b48-8452-1e2150d845e4 req-ad969741-1e1d-4fdb-9adc-cd3def57dcc5 tempest-TestServerVolumeAttachmentScenario-305932398 None] attachment_update completed successfully. Sep 30 19:45:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4f2b5757-431b-41f2-929e-29f449c032fc req-0d8f0da5-6f4c-4306-9291-806bd9f42c85 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:45:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4f2b5757-431b-41f2-929e-29f449c032fc req-0d8f0da5-6f4c-4306-9291-806bd9f42c85 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:45:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4f2b5757-431b-41f2-929e-29f449c032fc req-0d8f0da5-6f4c-4306-9291-806bd9f42c85 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:45:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-4f2b5757-431b-41f2-929e-29f449c032fc req-0d8f0da5-6f4c-4306-9291-806bd9f42c85 tempest-TestInstancesWithCinderVolumes-1503083992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec4d643f-6cce-4326-b697-346f88a5ab20', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:45:50 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-4f2b5757-431b-41f2-929e-29f449c032fc req-0d8f0da5-6f4c-4306-9291-806bd9f42c85 tempest-TestInstancesWithCinderVolumes-1503083992 None] attachment_update completed successfully. Sep 30 19:45:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-d811dabd-6856-45e9-8eb9-a4494b24c2cd req-80bfc150-30c5-42c2-b10e-9856fc577803 tempest-TestServerVolumeAttachmentScenario-305932398 None] Terminate volume connection completed successfully. Sep 30 19:45:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-d811dabd-6856-45e9-8eb9-a4494b24c2cd req-80bfc150-30c5-42c2-b10e-9856fc577803 tempest-TestServerVolumeAttachmentScenario-305932398 None] Deleting attachment b76fcd50-7740-4030-9bf9-b9253ead77cd. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:45:54 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-cc63ba9c-12dc-48ff-a7f4-53db2af5d6df req-1e47e9f5-6daa-49d9-9fdd-44ab5f2b2f1e tempest-TestServerVolumeAttachmentScenario-305932398 None] Terminate volume connection completed successfully. Sep 30 19:45:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-cc63ba9c-12dc-48ff-a7f4-53db2af5d6df req-1e47e9f5-6daa-49d9-9fdd-44ab5f2b2f1e tempest-TestServerVolumeAttachmentScenario-305932398 None] Deleting attachment 767ac091-77df-4897-9832-5ca33e308727. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:45:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-c14ed964-7b78-4e4b-a578-abd5bcefd0e8 req-13cd04f8-4441-4363-8cae-8b8f55850838 tempest-TestInstancesWithCinderVolumes-1503083992 None] Terminate volume connection completed successfully. Sep 30 19:45:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-c14ed964-7b78-4e4b-a578-abd5bcefd0e8 req-13cd04f8-4441-4363-8cae-8b8f55850838 tempest-TestInstancesWithCinderVolumes-1503083992 None] Deleting attachment 183561f6-475c-427e-b2bf-0cc39e6edd65. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:45:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "cinder-3090567a-0ad9-491e-a8bf-52fe71dc57fb-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:45:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-3090567a-0ad9-491e-a8bf-52fe71dc57fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:45:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "cinder-quobyte-3090567a-0ad9-491e-a8bf-52fe71dc57fb" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:45:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-quobyte-3090567a-0ad9-491e-a8bf-52fe71dc57fb" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:45:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b767c3a8-6363-468e-a6eb-8569abaa7a03]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:45:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:59 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb Sep 30 19:45:59 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:59 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb" returned: 0 in 0.631s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:45:59 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb Sep 30 19:45:59 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:45:59 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Sep 30 19:45:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3090567a-0ad9-491e-a8bf-52fe71dc57fb" returned: 0 in 0.351s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:45:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-quobyte-3090567a-0ad9-491e-a8bf-52fe71dc57fb" released by "delete_volume" :: held 1.058s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:45:59 devstack cinder-volume[87426]: WARNING cinder.quota [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1041051362-196277702 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1041051362-196277702, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:45:59 devstack cinder-volume[87426]: WARNING cinder.quota [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1041051362-196277702 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1041051362-196277702, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:45:59 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Created reservations ['0733e38e-952a-452d-87a8-a501bf109b8d', '875d0b88-ab0e-4ae1-ad77-3a14cf5555a0', 'de4c3c4b-7b56-45f9-a412-2e9444ab2700', '7b208309-75ce-4f5b-b1dd-b90e15107019'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:00 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:00 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Flow 'volume_create_manager' (d87b8d5a-7a78-47d8-9aa4-69dcf998d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e85030-b70a-45ec-8aee-a10bc09f0688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e85030-b70a-45ec-8aee-a10bc09f0688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-260583569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f7d6ce-9bd0-4d82-be90-19941f255622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470b72e8d13c4c73891888b1ea5db9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:00Z,use_quota=True,user_id='a32b34e705bb4985b516e419013a91b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61311009-aae7-4e88-a37b-8408cf90afb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:00 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61311009-aae7-4e88-a37b-8408cf90afb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638612a0-6f67-4b60-a207-ca4352c7c592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.310s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Deleted volume successfully. Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44e61d6f-d9b3-405b-bd06-9382509fd573 tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-3090567a-0ad9-491e-a8bf-52fe71dc57fb-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638612a0-6f67-4b60-a207-ca4352c7c592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66f7d6ce-9bd0-4d82-be90-19941f255622', 'volume_name': 'volume-66f7d6ce-9bd0-4d82-be90-19941f255622', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4309546-0b4e-4aa4-9839-d2c34d4b7542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4309546-0b4e-4aa4-9839-d2c34d4b7542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e67624-86bc-4560-9fe1-0681e9616bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:00 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Volume 66f7d6ce-9bd0-4d82-be90-19941f255622: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66f7d6ce-9bd0-4d82-be90-19941f255622', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 19:46:00 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Trying to clone 66f7d6ce-9bd0-4d82-be90-19941f255622 from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b at location (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:46:01 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Image download 20.69 MB at 20.69 MB/s Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd91f39-1af3-47ed-9120-9b9ffbb8322e]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:01 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD Sep 30 19:46:01 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "cinder-af934e42-f4a7-4176-b074-364acb0b0c24-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "cinder-af934e42-f4a7-4176-b074-364acb0b0c24-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:01 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b is fetched for user a32b34e705bb4985b516e419013a91b2. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "cinder-quobyte-af934e42-f4a7-4176-b074-364acb0b0c24" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "cinder-quobyte-af934e42-f4a7-4176-b074-364acb0b0c24" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7e31c-8e1f-40a0-8bc7-ce1a93a30bc6]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2345407-f95b-44fe-9b48-e9179fc845af]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:01 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24 Sep 30 19:46:01 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:01 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD Sep 30 19:46:01 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:02 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-260583569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f7d6ce-9bd0-4d82-be90-19941f255622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470b72e8d13c4c73891888b1ea5db9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:00Z,use_quota=True,user_id='a32b34e705bb4985b516e419013a91b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Creating volume 66f7d6ce-9bd0-4d82-be90-19941f255622 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:46:02 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:02 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24" returned: 0 in 0.419s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:02 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 1073741824 Sep 30 19:46:02 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:02 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24 Sep 30 19:46:02 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:02 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-af934e42-f4a7-4176-b074-364acb0b0c24" returned: 0 in 0.278s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "cinder-quobyte-af934e42-f4a7-4176-b074-364acb0b0c24" released by "delete_volume" :: held 0.753s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Created reservations ['546a7f92-220e-437c-887d-fbb5fbe6b347', '03ae40d9-2e1a-4518-8d85-75c504ed5a33', '42e1a7c7-01a9-4e07-8d8a-ad64311f9948', '10ec2fee-899a-46de-87c2-a1f704b07df6'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:02 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:02 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:02 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 1073741824" returned: 0 in 0.509s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:02 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 Sep 30 19:46:02 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "cinder-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "cinder-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "cinder-quobyte-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "cinder-quobyte-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:03 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.385s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Deleted volume successfully. Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aaac62-c1a4-40f4-8999-ebee9c7333b8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-faaf05da-b906-481a-a746-b8927a707993 tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "cinder-af934e42-f4a7-4176-b074-364acb0b0c24-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:03 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622" returned: 0 in 0.372s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Attempting download of 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume 66f7d6ce-9bd0-4d82-be90-19941f255622. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:46:03 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f Sep 30 19:46:03 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae7b28-53bd-43b1-81d5-a546dba0450b]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_u460e5aw {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:03 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_u460e5aw Sep 30 19:46:03 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:03 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f" returned: 0 in 0.413s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:03 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f Sep 30 19:46:03 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-d24d3d53-52de-49a6-ac98-e44157c49c6b req-bd6fa0b0-7b0c-40a4-9170-4f6c6e5fa445 tempest-TestInstancesWithCinderVolumes-1503083992 None] Terminate volume connection completed successfully. Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-d24d3d53-52de-49a6-ac98-e44157c49c6b req-bd6fa0b0-7b0c-40a4-9170-4f6c6e5fa445 tempest-TestInstancesWithCinderVolumes-1503083992 None] Deleting attachment ec4d643f-6cce-4326-b697-346f88a5ab20. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:46:03 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_u460e5aw" returned: 0 in 0.340s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_u460e5aw {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:03 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_u460e5aw Sep 30 19:46:03 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:03 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f" returned: 0 in 0.285s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "cinder-quobyte-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f" released by "delete_volume" :: held 0.753s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Created reservations ['28b1e381-774b-4f6d-8e68-bbda8b53913e', 'f0c9a40e-c8ac-43ce-a906-e6fc26037be8', '029d9583-4fe2-4467-9bab-cbe4eabbd417', '007eea48-3cff-42b9-bcf5-1852fd758d04'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:03 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_u460e5aw" returned: 1 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_u460e5aw' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1fcc3f-3ec1-422c-8e2c-7a50ce936c5e]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:03 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:03 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:04 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD Sep 30 19:46:04 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "cinder-37ebdf23-1602-4de3-a706-4d1ecfac24b4-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-37ebdf23-1602-4de3-a706-4d1ecfac24b4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "cinder-quobyte-37ebdf23-1602-4de3-a706-4d1ecfac24b4" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:04 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-quobyte-37ebdf23-1602-4de3-a706-4d1ecfac24b4" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.346s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:04 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Deleted volume successfully. Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b9cbbe-a440-457e-aa9a-6711d744cb23]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:04 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7fe3ecf-53ff-413f-9fbe-55246405911e tempest-TestServerVolumeAttachmentScenario-305932398 None] Lock "cinder-cf8ea3af-37c6-4d9c-883f-4cba0c7e5b1f-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] 5be8283e-b86b-4bc8-8baa-e16813f20b2b was qcow2, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:04 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 Sep 30 19:46:04 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:04 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 Sep 30 19:46:04 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:04 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4" returned: 0 in 0.445s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:04 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4 Sep 30 19:46:04 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:05 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-37ebdf23-1602-4de3-a706-4d1ecfac24b4" returned: 0 in 0.418s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-quobyte-37ebdf23-1602-4de3-a706-4d1ecfac24b4" released by "delete_volume" :: held 0.946s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:05 devstack cinder-volume[87426]: WARNING cinder.quota [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-551798816-1708336845 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-551798816-1708336845, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:46:05 devstack cinder-volume[87426]: WARNING cinder.quota [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-551798816-1708336845 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-551798816-1708336845, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Created reservations ['69b5b27f-ffb4-484f-be83-a427c8044bcb', 'efbd37a0-0a92-48bc-969e-dccb49fd15ca', 'ad89c366-0bb4-4585-a354-9f6aa0061f76', '4a87c02d-3426-4278-b6da-5018f5d9c4b0'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:05 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:05 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:05 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.369s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:05 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Deleted volume successfully. Sep 30 19:46:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-04a94fd7-b179-4ba8-9c12-abed6f81b19d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-37ebdf23-1602-4de3-a706-4d1ecfac24b4-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:07 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622" returned: 0 in 2.685s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_yz1d0vr9devstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:46:07 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Converted 112.00 MB image at 41.69 MB/s Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:07 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 1G Sep 30 19:46:07 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:07 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 1G" returned: 0 in 0.470s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Downloaded image 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume 66f7d6ce-9bd0-4d82-be90-19941f255622 successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b for user a32b34e705bb4985b516e419013a91b2 is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Marking volume 66f7d6ce-9bd0-4d82-be90-19941f255622 as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Copying metadata from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b to 66f7d6ce-9bd0-4d82-be90-19941f255622. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Creating volume glance metadata for volume 66f7d6ce-9bd0-4d82-be90-19941f255622 backed by image 5be8283e-b86b-4bc8-8baa-e16813f20b2b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e67624-86bc-4560-9fe1-0681e9616bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f7d6ce-9bd0-4d82-be90-19941f255622', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9170cbcf-dc29-4ff6-bf6f-515b655aa3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:07 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Volume volume-66f7d6ce-9bd0-4d82-be90-19941f255622 (66f7d6ce-9bd0-4d82-be90-19941f255622): created successfully Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9170cbcf-dc29-4ff6-bf6f-515b655aa3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Flow 'volume_create_manager' (d87b8d5a-7a78-47d8-9aa4-69dcf998d699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-bd6f2da3-486d-48cd-9118-c5385b25c98c tempest-TestShelveInstance-399002775 None] Created volume successfully. Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Flow 'volume_create_manager' (362c79e1-f6ab-433c-9172-9daf52c6a472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fd8b7b-367a-4e0a-8255-4947eff8dcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89fd8b7b-367a-4e0a-8255-4947eff8dcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-756120729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3076e94-1a43-459c-b8de-529eeda183d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6178139e3d4e18b52725b563f4bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:08Z,use_quota=True,user_id='a175b2c5dd964331a84360accf02f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36367762-8b29-4fcd-8df5-00a4eb522dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36367762-8b29-4fcd-8df5-00a4eb522dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a110dae-82f7-4c81-9baa-557e99380e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a110dae-82f7-4c81-9baa-557e99380e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3076e94-1a43-459c-b8de-529eeda183d7', 'volume_name': 'volume-b3076e94-1a43-459c-b8de-529eeda183d7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6077b999-d8f3-46a6-8ce2-1d7c201d1ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6077b999-d8f3-46a6-8ce2-1d7c201d1ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a2e315-dfe5-4005-95a0-88bd0e9d0515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:08 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Volume b3076e94-1a43-459c-b8de-529eeda183d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3076e94-1a43-459c-b8de-529eeda183d7', 'volume_size': 1} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-756120729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3076e94-1a43-459c-b8de-529eeda183d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6178139e3d4e18b52725b563f4bede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:08Z,use_quota=True,user_id='a175b2c5dd964331a84360accf02f7c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Creating volume b3076e94-1a43-459c-b8de-529eeda183d7 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:46:08 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:46:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:08 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7 1073741824 Sep 30 19:46:08 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:09 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7 1073741824" returned: 0 in 0.685s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:09 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7 Sep 30 19:46:09 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:09 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7" returned: 0 in 0.366s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:46:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a2e315-dfe5-4005-95a0-88bd0e9d0515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3076e94-1a43-459c-b8de-529eeda183d7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30aa830d-162e-4545-b130-bd7024531b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:09 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Volume volume-b3076e94-1a43-459c-b8de-529eeda183d7 (b3076e94-1a43-459c-b8de-529eeda183d7): created successfully Sep 30 19:46:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30aa830d-162e-4545-b130-bd7024531b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Flow 'volume_create_manager' (362c79e1-f6ab-433c-9172-9daf52c6a472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-70a2c039-df45-49df-bb9f-4d5d292416e0 tempest-AttachVolumeNegativeTest-1406576198 None] Created volume successfully. Sep 30 19:46:10 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-5c8c9122-0fae-4b70-aecf-cb3d8ae260ad req-5f1390b4-9c0b-4aa9-9d45-1eb2dde59ff2 tempest-TestInstancesWithCinderVolumes-1503083992 None] Terminate volume connection completed successfully. Sep 30 19:46:10 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-5c8c9122-0fae-4b70-aecf-cb3d8ae260ad req-5f1390b4-9c0b-4aa9-9d45-1eb2dde59ff2 tempest-TestInstancesWithCinderVolumes-1503083992 None] Deleting attachment 23e38018-0781-4a35-a012-f6b4890ca24f. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "cinder-5a088578-b406-4ae4-a62d-b30f683f0baa-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-5a088578-b406-4ae4-a62d-b30f683f0baa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "cinder-quobyte-5a088578-b406-4ae4-a62d-b30f683f0baa" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-quobyte-5a088578-b406-4ae4-a62d-b30f683f0baa" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e525a5-16da-4e0e-81d2-dc3a37504878]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:11 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa Sep 30 19:46:11 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-f792f46a-d5a8-4ce1-b6f0-ed0f4ecfbeb1 req-4c78d500-999b-4b80-a065-3598ea50b221 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-f792f46a-d5a8-4ce1-b6f0-ed0f4ecfbeb1 req-4c78d500-999b-4b80-a065-3598ea50b221 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-f792f46a-d5a8-4ce1-b6f0-ed0f4ecfbeb1 req-4c78d500-999b-4b80-a065-3598ea50b221 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:11 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-f792f46a-d5a8-4ce1-b6f0-ed0f4ecfbeb1 req-4c78d500-999b-4b80-a065-3598ea50b221 tempest-AttachVolumeNegativeTest-1406576198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-b3076e94-1a43-459c-b8de-529eeda183d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d3e30bb-074c-4ebf-bf58-68d91f85bcd9', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:46:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-f792f46a-d5a8-4ce1-b6f0-ed0f4ecfbeb1 req-4c78d500-999b-4b80-a065-3598ea50b221 tempest-AttachVolumeNegativeTest-1406576198 None] attachment_update completed successfully. Sep 30 19:46:12 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa" returned: 0 in 0.477s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:12 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa Sep 30 19:46:12 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:12 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5a088578-b406-4ae4-a62d-b30f683f0baa" returned: 0 in 0.386s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-quobyte-5a088578-b406-4ae4-a62d-b30f683f0baa" released by "delete_volume" :: held 0.944s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:12 devstack cinder-volume[87426]: WARNING cinder.quota [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-786588688-1905279518 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-786588688-1905279518, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:46:12 devstack cinder-volume[87426]: WARNING cinder.quota [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-786588688-1905279518 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-786588688-1905279518, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Created reservations ['f8257895-3151-4381-be8d-1933b49f1d30', 'd4b60e45-d0b4-4a11-8354-6f9a90dd921a', '33abca25-384d-4c27-a072-f60dc171f4af', '004f4d16-9ee8-425e-8228-c5392bc2d2c7'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:12 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:12 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-33fbf501-2856-40eb-b022-80cc6c2dbe1c req-3fe177ff-33d8-42b5-9358-0df154caaa1a tempest-TestShelveInstance-399002775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-33fbf501-2856-40eb-b022-80cc6c2dbe1c req-3fe177ff-33d8-42b5-9358-0df154caaa1a tempest-TestShelveInstance-399002775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-33fbf501-2856-40eb-b022-80cc6c2dbe1c req-3fe177ff-33d8-42b5-9358-0df154caaa1a tempest-TestShelveInstance-399002775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.081s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:13 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.556s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:13 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:13 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Deleted volume successfully. Sep 30 19:46:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-33fbf501-2856-40eb-b022-80cc6c2dbe1c req-3fe177ff-33d8-42b5-9358-0df154caaa1a tempest-TestShelveInstance-399002775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-66f7d6ce-9bd0-4d82-be90-19941f255622', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cd6d5e4-88cd-461b-9361-e1a5ca12fa18', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:46:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b382e983-1b51-4a1f-87fa-89a717e0244d tempest-TestInstancesWithCinderVolumes-1503083992 None] Lock "cinder-5a088578-b406-4ae4-a62d-b30f683f0baa-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:13 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-33fbf501-2856-40eb-b022-80cc6c2dbe1c req-3fe177ff-33d8-42b5-9358-0df154caaa1a tempest-TestShelveInstance-399002775 None] attachment_update completed successfully. Sep 30 19:46:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-0fd988d6-4b92-4b3f-a358-83bd96e88242 req-9249b991-d1f7-4b34-b2f6-ea52e289aa52 tempest-AttachVolumeNegativeTest-1406576198 None] Terminate volume connection completed successfully. Sep 30 19:46:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-0fd988d6-4b92-4b3f-a358-83bd96e88242 req-9249b991-d1f7-4b34-b2f6-ea52e289aa52 tempest-AttachVolumeNegativeTest-1406576198 None] Deleting attachment 1d3e30bb-074c-4ebf-bf58-68d91f85bcd9. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:46:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:46:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:46:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:46:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "cinder-b3076e94-1a43-459c-b8de-529eeda183d7-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-b3076e94-1a43-459c-b8de-529eeda183d7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "cinder-quobyte-b3076e94-1a43-459c-b8de-529eeda183d7" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-quobyte-b3076e94-1a43-459c-b8de-529eeda183d7" acquired by "delete_volume" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:24 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[16827bf4-c01f-4c48-8d65-eee90cd80e6a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:24 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7 Sep 30 19:46:24 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:24 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7" returned: 0 in 0.652s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:24 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7 Sep 30 19:46:24 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:25 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b3076e94-1a43-459c-b8de-529eeda183d7" returned: 0 in 0.588s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-quobyte-b3076e94-1a43-459c-b8de-529eeda183d7" released by "delete_volume" :: held 1.308s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:25 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Created reservations ['e1aeca65-26f2-4c9a-abef-81c970c9561c', 'e49eb516-0c63-4da1-a234-3845087198aa', '8fba6515-4105-4d28-82dd-dffa0b3df342', '0f9ad782-38c3-4c55-bd87-13ca78f35105'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:25 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:25 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:26 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.441s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:26 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:26 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Deleted volume successfully. Sep 30 19:46:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2af2170-e7c1-4369-b87c-22c4e6aab832 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-b3076e94-1a43-459c-b8de-529eeda183d7-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "cinder-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "cinder-quobyte-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-quobyte-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:26 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1868e0e3-f28b-43d9-9ef2-c6b385da8f35]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:26 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e Sep 30 19:46:26 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:27 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e" returned: 0 in 0.508s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:27 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e Sep 30 19:46:27 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:27 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e" returned: 0 in 0.340s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-quobyte-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e" released by "delete_volume" :: held 0.929s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Created reservations ['46976fc7-07b5-4056-b0b1-d90869553a66', '0e76e679-6606-41a8-bd11-655318585ee7', 'ad195df4-c115-471e-a886-6d7397b0a0b2', '0e23e4dc-9abd-4b2d-ba11-8b07f978a8e5'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:28 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:28 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:28 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.337s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:28 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Deleted volume successfully. Sep 30 19:46:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7a0db9e7-1f2a-4238-82d5-858e12b044c2 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-93c0ad21-bfb9-490e-b328-3bcd7ef9b54e-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "cinder-19537f02-4314-4b29-b811-c741fa25f5c1-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-19537f02-4314-4b29-b811-c741fa25f5c1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "cinder-quobyte-19537f02-4314-4b29-b811-c741fa25f5c1" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-quobyte-19537f02-4314-4b29-b811-c741fa25f5c1" acquired by "delete_volume" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e698e32-3871-4fde-8549-59dc8cc709e5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:29 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1 Sep 30 19:46:29 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:30 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1" returned: 0 in 0.468s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:30 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1 Sep 30 19:46:30 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:30 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-19537f02-4314-4b29-b811-c741fa25f5c1" returned: 0 in 0.366s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-quobyte-19537f02-4314-4b29-b811-c741fa25f5c1" released by "delete_volume" :: held 0.917s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Created reservations ['9d52de57-b53c-4561-a095-86c7c9a59cab', 'b5e92e65-28b3-43a5-9802-1a563923bea7', '620f13ec-a5fc-439d-9dba-96812da94fef', 'c58066fb-c369-4833-b718-ee74b828b526'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:30 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:30 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:31 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.419s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:31 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Deleted volume successfully. Sep 30 19:46:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4969371c-1ea1-4480-af96-3f16071ecce0 tempest-AttachVolumeNegativeTest-1406576198 None] Lock "cinder-19537f02-4314-4b29-b811-c741fa25f5c1-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:40 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=95,cinder:UPDATE=87,cinder:INSERT=25,cinder:DELETE=4 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=107,cinder:UPDATE=83,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Flow 'volume_create_manager' (47ccaf04-cb10-43ff-b6f1-5e260c8dca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c891b466-5d41-40de-949f-a8d01610635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c891b466-5d41-40de-949f-a8d01610635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476d37ab-4c0d-4655-b55f-0fa895cafa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5dfad9bc76b40d7a6cba1e7d813dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:42Z,use_quota=True,user_id='376eab0642cf47d7bc81c4a763b5d0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7a398a-eea1-499e-a97c-f04a78c97a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7a398a-eea1-499e-a97c-f04a78c97a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca530bd5-6d17-49ea-a578-78f075d27396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca530bd5-6d17-49ea-a578-78f075d27396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476d37ab-4c0d-4655-b55f-0fa895cafa64', 'volume_name': 'volume-476d37ab-4c0d-4655-b55f-0fa895cafa64', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91355388-ecfe-422f-9b77-8e27346e3844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91355388-ecfe-422f-9b77-8e27346e3844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb016c51-15d7-4fc9-96bb-37465c84e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:41 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Volume 476d37ab-4c0d-4655-b55f-0fa895cafa64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476d37ab-4c0d-4655-b55f-0fa895cafa64', 'volume_size': 1} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476d37ab-4c0d-4655-b55f-0fa895cafa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5dfad9bc76b40d7a6cba1e7d813dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:42Z,use_quota=True,user_id='376eab0642cf47d7bc81c4a763b5d0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Creating volume 476d37ab-4c0d-4655-b55f-0fa895cafa64 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:46:41 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:46:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:41 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 1073741824 Sep 30 19:46:41 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:42 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 1073741824" returned: 0 in 0.722s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:42 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 Sep 30 19:46:42 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:42 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64" returned: 0 in 0.275s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:46:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb016c51-15d7-4fc9-96bb-37465c84e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476d37ab-4c0d-4655-b55f-0fa895cafa64', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cfc3aa-61c1-4339-b4e2-630d03862690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:43 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Volume volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 (476d37ab-4c0d-4655-b55f-0fa895cafa64): created successfully Sep 30 19:46:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cfc3aa-61c1-4339-b4e2-630d03862690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Flow 'volume_create_manager' (47ccaf04-cb10-43ff-b6f1-5e260c8dca8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:43 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2d48f885-5a48-4167-ae78-751539c22740 tempest-CinderUnicodeTest-822761582 None] Created volume successfully. Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Flow 'volume_create_manager' (b4e2dba8-1412-411f-8c6f-b6cb2c200057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20cabff-7364-416c-b80a-e04bbdb9508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20cabff-7364-416c-b80a-e04bbdb9508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1208101683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5dfad9bc76b40d7a6cba1e7d813dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:44Z,use_quota=True,user_id='376eab0642cf47d7bc81c4a763b5d0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80e7a90-1ee0-46ef-ab57-44a40e1a9ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80e7a90-1ee0-46ef-ab57-44a40e1a9ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a751f88-14d0-402e-8df2-b88dad1b2ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a751f88-14d0-402e-8df2-b88dad1b2ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac', 'volume_name': 'volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ece2e06-092b-47ce-a9e5-3f9253e3c134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ece2e06-092b-47ce-a9e5-3f9253e3c134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4268e2b-afd4-4253-8be7-fd52c868b9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:44 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Volume ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac', 'volume_size': 1} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1208101683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5dfad9bc76b40d7a6cba1e7d813dc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:44Z,use_quota=True,user_id='376eab0642cf47d7bc81c4a763b5d0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Creating volume ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:46:44 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:46:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:44 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac 1073741824 Sep 30 19:46:44 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:45 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac 1073741824" returned: 0 in 0.514s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:45 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac Sep 30 19:46:45 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:45 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" returned: 0 in 0.433s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:46:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4268e2b-afd4-4253-8be7-fd52c868b9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb4b871-aad2-4f4c-9805-1930da010069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:45 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Volume volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac (ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac): created successfully Sep 30 19:46:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb4b871-aad2-4f4c-9805-1930da010069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Flow 'volume_create_manager' (b4e2dba8-1412-411f-8c6f-b6cb2c200057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-9ab35467-dba8-4167-a0c8-eac58ca9bf00 tempest-CinderUnicodeTest-822761582 None] Created volume successfully. Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Flow 'volume_create_manager' (7e52ed1e-6d19-41ee-bb55-a56c18d2a205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758a932e-f82f-46b9-878f-9ff99700d1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758a932e-f82f-46b9-878f-9ff99700d1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1375712323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a90461-1614-46e4-91d4-d2ae87151458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902376b944f245d88c5e9c291ae9289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:46Z,use_quota=True,user_id='8b625150cc1c4fe19ef81a7bf89bf9c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3869add2-f016-4494-a751-85f9f6272c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3869add2-f016-4494-a751-85f9f6272c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6027c1a-0212-4bed-a094-6a7300395b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6027c1a-0212-4bed-a094-6a7300395b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a90461-1614-46e4-91d4-d2ae87151458', 'volume_name': 'volume-f7a90461-1614-46e4-91d4-d2ae87151458', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624f528c-807e-44b2-a79e-870fa1eb252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624f528c-807e-44b2-a79e-870fa1eb252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e378a7-c907-4098-b3eb-383ab71a84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:46 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Volume f7a90461-1614-46e4-91d4-d2ae87151458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a90461-1614-46e4-91d4-d2ae87151458', 'volume_size': 1} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1375712323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a90461-1614-46e4-91d4-d2ae87151458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902376b944f245d88c5e9c291ae9289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:46Z,use_quota=True,user_id='8b625150cc1c4fe19ef81a7bf89bf9c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Creating volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:46:46 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:46 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 1073741824 Sep 30 19:46:46 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:46 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 1073741824" returned: 0 in 0.537s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:47 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 Sep 30 19:46:47 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:47 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.462s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e378a7-c907-4098-b3eb-383ab71a84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a90461-1614-46e4-91d4-d2ae87151458', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9520ed-950f-4173-9b1f-f53a1083cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Creating offline snapshot 1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 of volume ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:46:47 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Volume volume-f7a90461-1614-46e4-91d4-d2ae87151458 (f7a90461-1614-46e4-91d4-d2ae87151458): created successfully Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9520ed-950f-4173-9b1f-f53a1083cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Flow 'volume_create_manager' (7e52ed1e-6d19-41ee-bb55-a56c18d2a205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6434fc2f-1774-406c-ab9a-aec878f8531d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:47 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d85a8560-4486-486e-ad6c-bb691ab91fc7 tempest-SnapshotsActionsTest-300237177 None] Created volume successfully. Sep 30 19:46:47 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac Sep 30 19:46:47 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:47 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" returned: 0 in 0.426s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:47 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 1G Sep 30 19:46:47 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:48 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 1G" returned: 0 in 0.483s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:48 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 Sep 30 19:46:48 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:48 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8" returned: 0 in 0.397s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:48 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 is being set with open permissions: ugo+rw Sep 30 19:46:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:48 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 Sep 30 19:46:48 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:48 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8" returned: 0 in 0.320s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:49 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.info Sep 30 19:46:49 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:49 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.info" returned: 0 in 0.297s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:49 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.info is being set with open permissions: ugo+rw Sep 30 19:46:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:49 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.info Sep 30 19:46:49 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:49 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.info" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.903s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Creating offline snapshot e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:46:49 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c559259c-aa21-42c9-828d-bfe4ed66e908 tempest-CinderUnicodeTest-822761582 None] Create snapshot completed successfully Sep 30 19:46:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe613e8b-0e1c-4225-914f-abcd81a04028]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:49 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 Sep 30 19:46:49 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Acquiring lock "cinder-1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Lock "cinder-1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Acquiring lock "cinder-quobyte-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Lock "cinder-quobyte-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Acquiring lock "cinder-quobyte-1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Lock "cinder-quobyte-1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Deleting offline snapshot 1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 of volume ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] snapshot_file for this snap is: volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d9f677-afe7-4769-9b4c-ac4a23eb1d71]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:50 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458" returned: 0 in 0.570s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:50 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 1G Sep 30 19:46:50 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:50 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 Sep 30 19:46:50 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:50 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8" returned: 0 in 0.647s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:46:50 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 1G" returned: 0 in 0.667s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[275d5304-9efe-42aa-a0a5-5e3dde3827d4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:51 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:46:51 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:51 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac Sep 30 19:46:51 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:51 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.543s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:51 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:51 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 is being set with open permissions: ugo+rw Sep 30 19:46:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" returned: 0 in 0.530s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:51 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:46:51 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:51 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 Sep 30 19:46:51 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:51 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.342s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:51 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.info Sep 30 19:46:51 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Flow 'volume_create_manager' (99a14186-b976-4abf-a187-cb064038ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe578ac-43cd-40e0-b0a2-2b60a76cfdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe578ac-43cd-40e0-b0a2-2b60a76cfdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-367985784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650c79ba-ae2a-4777-9819-143e29cf15d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ca886f6ae942a7ba933bb70318e69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:52Z,use_quota=True,user_id='81ad62f8fac34481a3ae56b7c89e0962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc23b25-3d1c-4c3e-99f2-05ea4deb8571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc23b25-3d1c-4c3e-99f2-05ea4deb8571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f23f7b-b95e-4285-a248-3478d70e1336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f23f7b-b95e-4285-a248-3478d70e1336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650c79ba-ae2a-4777-9819-143e29cf15d2', 'volume_name': 'volume-650c79ba-ae2a-4777-9819-143e29cf15d2', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ae9b56-33fc-4a97-9bc0-14e6ea1cf7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ae9b56-33fc-4a97-9bc0-14e6ea1cf7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447786f0-9a29-40be-82d1-6aa4bf95da53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:52 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Volume 650c79ba-ae2a-4777-9819-143e29cf15d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650c79ba-ae2a-4777-9819-143e29cf15d2', 'volume_size': 1} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:52 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8" returned: 0 in 0.646s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:52 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8 Sep 30 19:46:52 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:52 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.info" returned: 0 in 0.385s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:52 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.info is being set with open permissions: ugo+rw Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:52 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.info Sep 30 19:46:52 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:52 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac.1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8" returned: 0 in 0.321s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Lock "cinder-quobyte-1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8" released by "_delete_snapshot" :: held 2.336s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Lock "cinder-quobyte-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" released by "delete_snapshot" :: held 2.376s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:52 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.info" returned: 0 in 0.323s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.043s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-367985784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650c79ba-ae2a-4777-9819-143e29cf15d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ca886f6ae942a7ba933bb70318e69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:46:52Z,use_quota=True,user_id='81ad62f8fac34481a3ae56b7c89e0962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Creating volume 650c79ba-ae2a-4777-9819-143e29cf15d2 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:46:52 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:52 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 1073741824 Sep 30 19:46:52 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Created reservations ['96d66420-ce94-40d8-9ef9-b80381a379e3', '375024d8-69e5-41e1-a545-cf4bda7ee3ee', 'd0486ddc-f3df-44e8-af10-1939e366ee7e', '8c707e0b-12b0-4f24-9557-f6243a7e5d98'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-557cea78-a915-47b7-b9b9-cc9facb7ca86 tempest-SnapshotsActionsTest-300237177 None] Create snapshot completed successfully Sep 30 19:46:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Delete snapshot completed successfully. Sep 30 19:46:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-286f838f-f6d1-4098-9528-323f40c91dbb tempest-CinderUnicodeTest-822761582 None] Lock "cinder-1bd9d5f9-ecf1-42c7-b930-9b86d8942cd8-delete_snapshot" released by "delete_snapshot" :: held 2.666s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:53 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 1073741824" returned: 0 in 0.556s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:53 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 Sep 30 19:46:53 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Acquiring lock "cinder-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Lock "cinder-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:53 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2" returned: 0 in 0.306s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Acquiring lock "cinder-quobyte-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447786f0-9a29-40be-82d1-6aa4bf95da53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650c79ba-ae2a-4777-9819-143e29cf15d2', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b022d242-706f-44d0-88b2-da70cb16a5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Creating offline snapshot 699d7d1c-7689-4ba3-80a0-8d1c2f615860 of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Lock "cinder-quobyte-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" acquired by "delete_volume" :: waited 0.083s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1640db3-df1f-436b-91a8-6d0b5f7da27b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Volume volume-650c79ba-ae2a-4777-9819-143e29cf15d2 (650c79ba-ae2a-4777-9819-143e29cf15d2): created successfully Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b022d242-706f-44d0-88b2-da70cb16a5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Flow 'volume_create_manager' (99a14186-b976-4abf-a187-cb064038ea53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57c741a-136a-44c1-9a48-822c1fe1561c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-701c86db-5409-4b28-a622-cf5917329877 tempest-TestImageHashVerification-668302998 None] Created volume successfully. Sep 30 19:46:53 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:46:53 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:53 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac Sep 30 19:46:53 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:54 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.461s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:54 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 1G Sep 30 19:46:54 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:54 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" returned: 0 in 0.535s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:54 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac Sep 30 19:46:54 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:54 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" returned: 0 in 0.386s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Lock "cinder-quobyte-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac" released by "delete_volume" :: held 1.025s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Created reservations ['cd6919fe-8aa5-45b5-942e-c06784609359', '8f06d945-93e7-4b61-aac8-e8ed515c9f8d', '6229b724-8664-4928-b356-fe510e897992', 'a566f55d-52ad-48bb-852d-1c5b1baadcec'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:54 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 1G" returned: 0 in 0.597s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:54 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 Sep 30 19:46:54 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:55 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:55 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:55 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860" returned: 0 in 0.571s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:55 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 is being set with open permissions: ugo+rw Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:55 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 Sep 30 19:46:55 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:55 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.410s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Deleted volume successfully. Sep 30 19:46:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-685dabd2-6864-45c6-92c4-d14f75a22e28 req-ca8ba559-9942-4c6a-a6af-3790f5e23660 tempest-TestShelveInstance-399002775 None] Terminate volume connection completed successfully. Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-685dabd2-6864-45c6-92c4-d14f75a22e28 req-ca8ba559-9942-4c6a-a6af-3790f5e23660 tempest-TestShelveInstance-399002775 None] Deleting attachment 9cd6d5e4-88cd-461b-9361-e1a5ca12fa18. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-843bf07f-569f-49ec-9440-9870c665bbab tempest-CinderUnicodeTest-822761582 None] Lock "cinder-ccddc4a8-ddc8-4cb2-87e1-ce420229f4ac-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:55 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860" returned: 0 in 0.296s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.332s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1877c0-6ea7-435d-ac39-ffbbd67f5d38]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6090ed45-f75e-4a17-ba41-a4a150ed0c1c tempest-SnapshotsActionsTest-300237177 None] Create snapshot completed successfully Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Acquiring lock "cinder-476d37ab-4c0d-4655-b55f-0fa895cafa64-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Lock "cinder-476d37ab-4c0d-4655-b55f-0fa895cafa64-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:55 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 Sep 30 19:46:55 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Acquiring lock "cinder-quobyte-476d37ab-4c0d-4655-b55f-0fa895cafa64" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Lock "cinder-quobyte-476d37ab-4c0d-4655-b55f-0fa895cafa64" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25d0b26-35ac-4eb1-baf6-4fd9f0c3b42a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:56 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 Sep 30 19:46:56 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:56 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2" returned: 0 in 0.408s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[852f4b73-e82c-4fbe-9394-8863ae79d856]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:56 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 Sep 30 19:46:56 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:56 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64" returned: 0 in 0.395s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:56 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64 Sep 30 19:46:56 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:56 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2" returned: 0 in 0.376s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 /opt/stack/data/cinder/conversion/650c79ba-ae2a-4777-9819-143e29cf15d2.temp_image.5c0752af-36e4-4ad7-b958-f20769385b1cnulqigjf.img {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:56 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 /opt/stack/data/cinder/conversion/650c79ba-ae2a-4777-9819-143e29cf15d2.temp_image.5c0752af-36e4-4ad7-b958-f20769385b1cnulqigjf.img Sep 30 19:46:56 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:56 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-476d37ab-4c0d-4655-b55f-0fa895cafa64" returned: 0 in 0.276s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Lock "cinder-quobyte-476d37ab-4c0d-4655-b55f-0fa895cafa64" released by "delete_volume" :: held 0.736s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Created reservations ['0758c17e-29e1-4286-8f89-6471ff94fe0f', 'c96abe27-9186-4e24-86dc-443d54ece9d4', '399e523d-015c-4e4b-9ff4-f35cf62f0c11', '94564c58-f312-41a4-82bd-df99588edbe3'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:56 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:46:56 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-699d7d1c-7689-4ba3-80a0-8d1c2f615860-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-699d7d1c-7689-4ba3-80a0-8d1c2f615860-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-quobyte-699d7d1c-7689-4ba3-80a0-8d1c2f615860" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-699d7d1c-7689-4ba3-80a0-8d1c2f615860" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Deleting offline snapshot 699d7d1c-7689-4ba3-80a0-8d1c2f615860 of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] snapshot_file for this snap is: volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c98a19-1554-4837-9d7c-c5910092a066]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:57 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.493s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:46:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Deleted volume successfully. Sep 30 19:46:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-de86e21f-04ba-4886-87ee-e9917d93ca79 tempest-CinderUnicodeTest-822761582 None] Lock "cinder-476d37ab-4c0d-4655-b55f-0fa895cafa64-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:46:57 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 Sep 30 19:46:57 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:58 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860" returned: 0 in 0.946s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:46:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[916d96bb-e18d-46e4-8168-26d4e9d64120]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:46:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:58 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:46:58 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:46:59 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 30 19:46:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 1.200s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:46:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:46:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:46:59 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 Sep 30 19:46:59 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:00 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860" returned: 0 in 1.025s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:00 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860 Sep 30 19:47:00 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:01 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.699d7d1c-7689-4ba3-80a0-8d1c2f615860" returned: 0 in 0.735s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-699d7d1c-7689-4ba3-80a0-8d1c2f615860" released by "_delete_snapshot" :: held 4.232s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" released by "delete_snapshot" :: held 4.296s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:01 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Created reservations ['613685cb-6e16-4cc5-9c7c-ae7e2428ab76', '89d56133-c7f6-4f90-afa3-dcfb9c14bd8f', 'c157fdab-7237-4bd1-8efd-43edecb59710', 'db039111-1486-453a-bec1-a92ef80a87c7'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:01 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Delete snapshot completed successfully. Sep 30 19:47:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-302d0f2b-b8b4-44c9-ba16-54f0f827f243 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-699d7d1c-7689-4ba3-80a0-8d1c2f615860-delete_snapshot" released by "delete_snapshot" :: held 4.625s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-9b257881-ee46-4a44-af4a-ca7d91efdb7a req-cab40e80-7c81-4905-8c18-ffcd92a045b2 tempest-TestShelveInstance-399002775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:05 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 /opt/stack/data/cinder/conversion/650c79ba-ae2a-4777-9819-143e29cf15d2.temp_image.5c0752af-36e4-4ad7-b958-f20769385b1cnulqigjf.img" returned: 0 in 8.576s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:05 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70b39a8-f34f-43f8-ae35-3d626fa67881]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:05 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 Sep 30 19:47:05 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:05 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2" returned: 0 in 0.528s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:05 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/conversion/650c79ba-ae2a-4777-9819-143e29cf15d2.temp_image.5c0752af-36e4-4ad7-b958-f20769385b1cnulqigjf.img {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:47:05 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Converted 1024.00 MB image at 119.39 MB/s Sep 30 19:47:05 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] 5c0752af-36e4-4ad7-b958-f20769385b1c was raw, no need to convert to raw {{(pid=87426) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 30 19:47:13 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=38,cinder:UPDATE=40,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:47:15 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=49,cinder:SELECT=47,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:47:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:47:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:24 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:47:24 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:24 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.344s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:47:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:47:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:47:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Flow 'volume_create_manager' (7a3b6b07-d859-4ab5-b6c0-cc6cd889bdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c7b3cd-b5f2-48f6-8a39-861be1657a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c7b3cd-b5f2-48f6-8a39-861be1657a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2108938380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067cb8d9-d851-45dc-b6a1-8d984f20127c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da69ad32bb0940c692b15054ff153347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:25Z,use_quota=True,user_id='1bc87c896af04bb98d037dfc5ebd1dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c4e4f6-0513-48f8-84cb-614685b3f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c4e4f6-0513-48f8-84cb-614685b3f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddbaeb2-5868-4f57-8414-8aff6a89f4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddbaeb2-5868-4f57-8414-8aff6a89f4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '067cb8d9-d851-45dc-b6a1-8d984f20127c', 'volume_name': 'volume-067cb8d9-d851-45dc-b6a1-8d984f20127c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e80776c-e1ab-4aab-bf6d-e1c33d0c8cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e80776c-e1ab-4aab-bf6d-e1c33d0c8cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db4b88f-a296-4acc-aa40-386868ac633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:25 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Volume 067cb8d9-d851-45dc-b6a1-8d984f20127c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-067cb8d9-d851-45dc-b6a1-8d984f20127c', 'volume_size': 1} Sep 30 19:47:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.725s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Uploaded volume to glance image-id: 5c0752af-36e4-4ad7-b958-f20769385b1c. {{(pid=87426) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-9b257881-ee46-4a44-af4a-ca7d91efdb7a req-cab40e80-7c81-4905-8c18-ffcd92a045b2 tempest-TestShelveInstance-399002775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 26.645s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-9b257881-ee46-4a44-af4a-ca7d91efdb7a req-cab40e80-7c81-4905-8c18-ffcd92a045b2 tempest-TestShelveInstance-399002775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.364s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c7f8bc79-b77a-47e7-a3d7-326af548ce6e tempest-TestImageHashVerification-668302998 None] Copy volume to image completed successfully. Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Creating offline snapshot 06628465-293f-440c-8220-a82dc4e29154 of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d39fd9-7a58-4118-9d5c-a5e9482886ce]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-9b257881-ee46-4a44-af4a-ca7d91efdb7a req-cab40e80-7c81-4905-8c18-ffcd92a045b2 tempest-TestShelveInstance-399002775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-66f7d6ce-9bd0-4d82-be90-19941f255622', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee8c5f0f-b5f0-496f-98ed-75e462790f66', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:47:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-9b257881-ee46-4a44-af4a-ca7d91efdb7a req-cab40e80-7c81-4905-8c18-ffcd92a045b2 tempest-TestShelveInstance-399002775 None] attachment_update completed successfully. Sep 30 19:47:28 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:47:28 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:28 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.407s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:28 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 1G Sep 30 19:47:28 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:29 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 1G" returned: 0 in 0.501s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:29 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 Sep 30 19:47:29 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Acquiring lock "cinder-650c79ba-ae2a-4777-9819-143e29cf15d2-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Lock "cinder-650c79ba-ae2a-4777-9819-143e29cf15d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Acquiring lock "cinder-quobyte-650c79ba-ae2a-4777-9819-143e29cf15d2" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Lock "cinder-quobyte-650c79ba-ae2a-4777-9819-143e29cf15d2" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f238be-16a0-4ce4-8687-548380b3747b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:29 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154" returned: 0 in 0.403s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:29 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 is being set with open permissions: ugo+rw Sep 30 19:47:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:29 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 Sep 30 19:47:29 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:29 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 Sep 30 19:47:29 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:30 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154" returned: 0 in 0.303s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:30 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.731s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.049s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2108938380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067cb8d9-d851-45dc-b6a1-8d984f20127c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da69ad32bb0940c692b15054ff153347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:25Z,use_quota=True,user_id='1bc87c896af04bb98d037dfc5ebd1dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Creating volume 067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:47:30 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2" returned: 0 in 0.435s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:30 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c 1073741824 Sep 30 19:47:30 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:30 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2 Sep 30 19:47:30 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6ea2358f-b3a7-4529-b718-66fd67c08a8d tempest-SnapshotsActionsTest-300237177 None] Create snapshot completed successfully Sep 30 19:47:30 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-650c79ba-ae2a-4777-9819-143e29cf15d2" returned: 0 in 0.315s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Lock "cinder-quobyte-650c79ba-ae2a-4777-9819-143e29cf15d2" released by "delete_volume" :: held 0.809s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Created reservations ['50dfd992-870e-41ac-9288-bdb64556b28b', '527353ed-2504-49bc-82f9-fa517bbfede8', '6e00efa5-5227-486d-a3eb-4b5ebe129ac2', '4068ac1b-4cfd-45bf-ac72-85838e0af3c0'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:30 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:47:30 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:30 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c 1073741824" returned: 0 in 0.577s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:30 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c Sep 30 19:47:30 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:31 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.327s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:47:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Deleted volume successfully. Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94711d4e-4b35-4e67-b4a0-b06cb8dd7e68 tempest-TestImageHashVerification-668302998 None] Lock "cinder-650c79ba-ae2a-4777-9819-143e29cf15d2-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:31 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c" returned: 0 in 0.353s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db4b88f-a296-4acc-aa40-386868ac633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067cb8d9-d851-45dc-b6a1-8d984f20127c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b8d7f9-e6ed-4a64-babe-bd2a67e33500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:31 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Volume volume-067cb8d9-d851-45dc-b6a1-8d984f20127c (067cb8d9-d851-45dc-b6a1-8d984f20127c): created successfully Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b8d7f9-e6ed-4a64-babe-bd2a67e33500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Flow 'volume_create_manager' (7a3b6b07-d859-4ab5-b6c0-cc6cd889bdb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6ded26aa-afcb-4f8a-b59d-9a6bdd493452 tempest-SnapshotDependencyTests-595961359 None] Created volume successfully. Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-06628465-293f-440c-8220-a82dc4e29154-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-06628465-293f-440c-8220-a82dc4e29154-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-quobyte-06628465-293f-440c-8220-a82dc4e29154" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-06628465-293f-440c-8220-a82dc4e29154" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Deleting offline snapshot 06628465-293f-440c-8220-a82dc4e29154 of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] snapshot_file for this snap is: volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[da202e79-2299-42c3-9c66-9f7d9a1602f4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:31 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 Sep 30 19:47:31 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Creating offline snapshot 30f44a86-a0b8-48b3-8012-ab37cfcb76ac of volume 067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d41e1-55cd-47a8-9e5f-942f6dec98b4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:32 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c Sep 30 19:47:32 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:32 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154" returned: 0 in 0.765s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad03ba6-3bbb-46c8-b2e8-5aa21ec4101b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:32 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:47:32 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:32 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c" returned: 0 in 0.523s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:32 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac 1G Sep 30 19:47:32 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:33 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.519s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:33 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 Sep 30 19:47:33 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:33 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac 1G" returned: 0 in 0.655s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-067cb8d9-d851-45dc-b6a1-8d984f20127c -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:33 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-067cb8d9-d851-45dc-b6a1-8d984f20127c -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac Sep 30 19:47:33 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:33 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154" returned: 0 in 0.592s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:33 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154 Sep 30 19:47:33 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:33 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-067cb8d9-d851-45dc-b6a1-8d984f20127c -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac" returned: 0 in 0.444s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:33 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac is being set with open permissions: ugo+rw Sep 30 19:47:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:33 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac Sep 30 19:47:33 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:34 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.06628465-293f-440c-8220-a82dc4e29154" returned: 0 in 0.345s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-06628465-293f-440c-8220-a82dc4e29154" released by "_delete_snapshot" :: held 2.537s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" released by "delete_snapshot" :: held 2.589s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Created reservations ['346c6789-35ff-4866-a550-c761be95566b', 'a630d0a8-9ec6-4b69-89ff-5bc0e41b9adb', '8549c724-909b-4661-aff4-94d0a613ce84', '7b6f211c-85d8-4292-88b0-a9b2908e5307'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:34 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac" returned: 0 in 0.313s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:34 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Delete snapshot completed successfully. Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0c369cb4-a7ed-4381-b214-c6c3552e77e2 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-06628465-293f-440c-8220-a82dc4e29154-delete_snapshot" released by "delete_snapshot" :: held 2.849s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:34 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.info Sep 30 19:47:34 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:34 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.info" returned: 0 in 0.308s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:34 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.info is being set with open permissions: ugo+rw Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:34 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.info Sep 30 19:47:34 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:34 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.info" returned: 0 in 0.411s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.887s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:35 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d5cf1612-52a4-48d6-8022-6e3074fe7ce4 tempest-SnapshotDependencyTests-595961359 None] Create snapshot completed successfully Sep 30 19:47:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Creating offline snapshot 9394de0e-4efb-4435-ab3d-128086a598ab of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:47:35 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbb828d-cd42-4761-9aff-5a70a9e0f699]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:35 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:47:35 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:35 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.566s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:36 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab 1G Sep 30 19:47:36 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Flow 'volume_create_manager' (24706eb5-3765-4039-a87e-859b662982de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a85906-e019-4357-8cd4-0e6edbc5b155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a85906-e019-4357-8cd4-0e6edbc5b155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacd01b9-5dad-4178-9b75-33a31abdce90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da69ad32bb0940c692b15054ff153347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30f44a86-a0b8-48b3-8012-ab37cfcb76ac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:36Z,use_quota=True,user_id='1bc87c896af04bb98d037dfc5ebd1dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23779573-d71a-47ff-a378-fb4dd5bb7b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23779573-d71a-47ff-a378-fb4dd5bb7b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97993f4-9fe9-42a2-bbe6-2a8b72c0b6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97993f4-9fe9-42a2-bbe6-2a8b72c0b6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cacd01b9-5dad-4178-9b75-33a31abdce90', 'volume_name': 'volume-cacd01b9-5dad-4178-9b75-33a31abdce90', 'volume_size': 1, 'snapshot_id': '30f44a86-a0b8-48b3-8012-ab37cfcb76ac'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a428a139-4df1-4e08-b7ee-63da2fff67d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a428a139-4df1-4e08-b7ee-63da2fff67d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8283f92-a639-42f8-a87b-cd0418cde768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:36 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Volume cacd01b9-5dad-4178-9b75-33a31abdce90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cacd01b9-5dad-4178-9b75-33a31abdce90', 'volume_size': 1, 'snapshot_id': '30f44a86-a0b8-48b3-8012-ab37cfcb76ac'} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:36 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab 1G" returned: 0 in 0.792s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:36 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab Sep 30 19:47:36 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:37 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab" returned: 0 in 0.398s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:37 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab is being set with open permissions: ugo+rw Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:37 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab Sep 30 19:47:37 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:37 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab" returned: 0 in 0.408s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.243s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "cinder-quobyte-30f44a86-a0b8-48b3-8012-ab37cfcb76ac-cacd01b9-5dad-4178-9b75-33a31abdce90" by "_create_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-30f44a86-a0b8-48b3-8012-ab37cfcb76ac-cacd01b9-5dad-4178-9b75-33a31abdce90" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Creating volume cacd01b9-5dad-4178-9b75-33a31abdce90 from snapshot 30f44a86-a0b8-48b3-8012-ab37cfcb76ac {{(pid=87426) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "cinder-quobyte-cacd01b9-5dad-4178-9b75-33a31abdce90" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:37 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6727e215-2639-4686-a091-d69e758de477 tempest-SnapshotsActionsTest-300237177 None] Create snapshot completed successfully Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-cacd01b9-5dad-4178-9b75-33a31abdce90" acquired by "_copy_volume_from_snapshot" :: waited 0.074s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] snapshot: 30f44a86-a0b8-48b3-8012-ab37cfcb76ac, volume: cacd01b9-5dad-4178-9b75-33a31abdce90, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b04b28-b534-4865-a52d-474d1dc651ad]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:38 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac Sep 30 19:47:38 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:38 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac" returned: 0 in 0.855s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-067cb8d9-d851-45dc-b6a1-8d984f20127c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9499d6-1ccb-4c58-9be8-73db9cd0891c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-9394de0e-4efb-4435-ab3d-128086a598ab-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-9394de0e-4efb-4435-ab3d-128086a598ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-quobyte-9394de0e-4efb-4435-ab3d-128086a598ab" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-9394de0e-4efb-4435-ab3d-128086a598ab" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Deleting offline snapshot 9394de0e-4efb-4435-ab3d-128086a598ab of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] snapshot_file for this snap is: volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd625ee5-8a52-4f7d-a6fb-2391323d873a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:39 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c Sep 30 19:47:39 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:39 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab Sep 30 19:47:39 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:39 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c" returned: 0 in 0.730s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:39 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 Sep 30 19:47:39 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:39 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab" returned: 0 in 0.794s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1f160-e47e-42ab-8535-7069e68457d2]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:40 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:47:40 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:40 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.815s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:40 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab Sep 30 19:47:40 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:42 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab" returned: 0 in 1.396s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:42 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab Sep 30 19:47:42 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:42 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.9394de0e-4efb-4435-ab3d-128086a598ab" returned: 0 in 0.593s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-9394de0e-4efb-4435-ab3d-128086a598ab" released by "_delete_snapshot" :: held 3.861s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" released by "delete_snapshot" :: held 3.913s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:42 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Created reservations ['0d3d6e31-f39d-4cbc-a86e-09e99f837e8d', 'ac338fdc-152a-48bc-91b0-6db9c8c696c9', 'd7fa9736-c3bd-425e-b979-eeb9a8a0d02c', '8bef365e-538d-49e2-9cef-b868b385cfc9'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:43 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Delete snapshot completed successfully. Sep 30 19:47:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-35531a28-199a-44cf-9aaa-e9ca41a152ae tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-9394de0e-4efb-4435-ab3d-128086a598ab-delete_snapshot" released by "delete_snapshot" :: held 4.199s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:48 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90" returned: 0 in 9.167s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:48 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c, size 1024.00 MB, duration 9.17 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:47:48 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Converted 1024.00 MB image at 111.69 MB/s Sep 30 19:47:48 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 is being set with open permissions: ugo+rw Sep 30 19:47:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:48 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 Sep 30 19:47:48 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:48 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90" returned: 0 in 0.251s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-cacd01b9-5dad-4178-9b75-33a31abdce90" released by "_copy_volume_from_snapshot" :: held 11.170s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-30f44a86-a0b8-48b3-8012-ab37cfcb76ac-cacd01b9-5dad-4178-9b75-33a31abdce90" released by "_create_volume_from_snapshot" :: held 11.312s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.374s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.963s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Creating offline snapshot b4404a2f-2530-4abd-aaee-5a9d4d134508 of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8283f92-a639-42f8-a87b-cd0418cde768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cacd01b9-5dad-4178-9b75-33a31abdce90', 'volume_size': 1, 'snapshot_id': '30f44a86-a0b8-48b3-8012-ab37cfcb76ac'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d828d2-facd-495d-acfa-dc389ef9dd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0d3fc4-2fa4-4379-bc44-5b6dfa1d287c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:49 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Volume volume-cacd01b9-5dad-4178-9b75-33a31abdce90 (cacd01b9-5dad-4178-9b75-33a31abdce90): created successfully Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d828d2-facd-495d-acfa-dc389ef9dd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Flow 'volume_create_manager' (24706eb5-3765-4039-a87e-859b662982de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:49 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-cb9d3e51-9a81-4ccf-a92c-f981a10e7968 tempest-SnapshotDependencyTests-595961359 None] Created volume successfully. Sep 30 19:47:49 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:47:49 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:49 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.436s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:49 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 1G Sep 30 19:47:49 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "cinder-30f44a86-a0b8-48b3-8012-ab37cfcb76ac-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-30f44a86-a0b8-48b3-8012-ab37cfcb76ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "cinder-quobyte-067cb8d9-d851-45dc-b6a1-8d984f20127c" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-067cb8d9-d851-45dc-b6a1-8d984f20127c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "cinder-quobyte-30f44a86-a0b8-48b3-8012-ab37cfcb76ac" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-30f44a86-a0b8-48b3-8012-ab37cfcb76ac" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Deleting offline snapshot 30f44a86-a0b8-48b3-8012-ab37cfcb76ac of volume 067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] snapshot_file for this snap is: volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e95a7-8f10-400c-886f-fe394fde8552]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:50 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 1G" returned: 0 in 0.599s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:50 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac Sep 30 19:47:50 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:50 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 Sep 30 19:47:50 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:50 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508" returned: 0 in 0.357s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:50 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 is being set with open permissions: ugo+rw Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:50 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac" returned: 0 in 0.520s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-067cb8d9-d851-45dc-b6a1-8d984f20127c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:50 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 Sep 30 19:47:50 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2e8a07-678b-453f-8580-c46012228d51]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:50 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c Sep 30 19:47:50 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:50 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508" returned: 0 in 0.296s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:50 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5b8c7d84-387a-4ad9-a986-7c30ccee388f tempest-SnapshotsActionsTest-300237177 None] Create snapshot completed successfully Sep 30 19:47:51 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c" returned: 0 in 0.652s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:51 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac Sep 30 19:47:51 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (e039a720-5b58-451e-b15a-f8d855dc4d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bb8023-2245-435f-9da8-1ec3cada5e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bb8023-2245-435f-9da8-1ec3cada5e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2012717846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8da5cd3-8dbe-4443-937e-9023e3b5d65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:52Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11842a7-b66f-470d-9745-e457172142d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11842a7-b66f-470d-9745-e457172142d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970bd339-1215-4bea-b4e3-be4691a22aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970bd339-1215-4bea-b4e3-be4691a22aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8da5cd3-8dbe-4443-937e-9023e3b5d65b', 'volume_name': 'volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9963b84d-e240-483d-babe-4a3683c3daf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9963b84d-e240-483d-babe-4a3683c3daf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82188a8f-9e8c-4ee1-9588-3b55759f5c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:51 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Volume c8da5cd3-8dbe-4443-937e-9023e3b5d65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b', 'volume_size': 1} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2012717846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8da5cd3-8dbe-4443-937e-9023e3b5d65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:52Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Creating volume c8da5cd3-8dbe-4443-937e-9023e3b5d65b {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:47:51 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:51 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b 1073741824 Sep 30 19:47:51 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:51 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac" returned: 0 in 0.608s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-b4404a2f-2530-4abd-aaee-5a9d4d134508-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:51 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac Sep 30 19:47:51 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-b4404a2f-2530-4abd-aaee-5a9d4d134508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Acquiring lock "cinder-quobyte-b4404a2f-2530-4abd-aaee-5a9d4d134508" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-b4404a2f-2530-4abd-aaee-5a9d4d134508" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Deleting offline snapshot b4404a2f-2530-4abd-aaee-5a9d4d134508 of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] snapshot_file for this snap is: volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccce5b56-f56f-41ee-8ad2-e3a6b76d8857]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:52 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 Sep 30 19:47:52 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:52 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b 1073741824" returned: 0 in 0.605s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:52 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b Sep 30 19:47:52 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:52 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c.30f44a86-a0b8-48b3-8012-ab37cfcb76ac" returned: 0 in 0.757s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (0b3a3f2b-df8d-4972-9a22-18f97b0db544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209cb71e-a026-4b76-9534-62d8ab2e36b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209cb71e-a026-4b76-9534-62d8ab2e36b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-953384619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d51162-a8a3-4330-be34-c355fddf7eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:53Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43210837-a0f1-40ea-bba6-9be77237e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43210837-a0f1-40ea-bba6-9be77237e55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1880a74-874e-40f1-8a57-6155a332b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1880a74-874e-40f1-8a57-6155a332b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d51162-a8a3-4330-be34-c355fddf7eab', 'volume_name': 'volume-65d51162-a8a3-4330-be34-c355fddf7eab', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c52a47-3680-4705-a1dc-24004a2fd9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:52 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c52a47-3680-4705-a1dc-24004a2fd9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e90574b-500a-4b79-ab06-290983a07ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:52 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Volume 65d51162-a8a3-4330-be34-c355fddf7eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d51162-a8a3-4330-be34-c355fddf7eab', 'volume_size': 1} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508" returned: 0 in 0.706s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-30f44a86-a0b8-48b3-8012-ab37cfcb76ac" released by "_delete_snapshot" :: held 2.897s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-067cb8d9-d851-45dc-b6a1-8d984f20127c" released by "delete_snapshot" :: held 2.941s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad7db13-edeb-41fa-b645-ab9dcfb7e964]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:53 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b" returned: 0 in 0.536s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.220s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-953384619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d51162-a8a3-4330-be34-c355fddf7eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:53Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Creating volume 65d51162-a8a3-4330-be34-c355fddf7eab {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:47:53 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:53 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:47:53 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Created reservations ['2486468c-e9a9-4e41-ae8e-d4b86aa06d06', '160b08a5-d753-4af2-9901-bcb82f273c56', 'a69d7de3-cf02-411a-a595-ab29870fa4a8', 'b6bc2901-4343-4928-acc8-e60a9c174df0'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82188a8f-9e8c-4ee1-9588-3b55759f5c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab 1073741824 Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb0500b-dfe0-4d67-b8b9-c12c602b777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Volume volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b (c8da5cd3-8dbe-4443-937e-9023e3b5d65b): created successfully Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb0500b-dfe0-4d67-b8b9-c12c602b777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (e039a720-5b58-451e-b15a-f8d855dc4d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-afdf7203-4c19-421e-b48d-d67506bfa8a4 tempest-CreateVolumesFromImageTest-1648426941 None] Created volume successfully. Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (d30923b6-fdb7-4783-8c65-73f3918c5296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044d478e-7f6f-45d4-9146-10b056234df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044d478e-7f6f-45d4-9146-10b056234df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1505074521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d1afcb-524a-4927-ba88-2ddb8b6b0839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:53Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0267586-50a0-45ee-b337-f2402559c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0267586-50a0-45ee-b337-f2402559c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e86d5e-f702-44b5-a3aa-8c0f5c6abe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e86d5e-f702-44b5-a3aa-8c0f5c6abe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d1afcb-524a-4927-ba88-2ddb8b6b0839', 'volume_name': 'volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33f0e2b-ff44-4aa8-8c40-af031c6b7dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33f0e2b-ff44-4aa8-8c40-af031c6b7dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b38d555-e7b0-4f7f-8195-f86ab36f1a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Volume 88d1afcb-524a-4927-ba88-2ddb8b6b0839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839', 'volume_size': 1} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Delete snapshot completed successfully. Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1b942b3d-77c4-4979-a008-5aa4fad5cfd8 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-30f44a86-a0b8-48b3-8012-ab37cfcb76ac-delete_snapshot" released by "delete_snapshot" :: held 3.440s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:47:53 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (501dce44-46f5-476a-a1e6-a77769352b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49835bcf-9429-42dd-b48e-5081debe8ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.748s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49835bcf-9429-42dd-b48e-5081debe8ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-463625852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bfe337-135b-4ba2-b658-6112500370d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:54Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b776d67-e009-43bc-b697-aa37ff3b02a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 Sep 30 19:47:53 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b776d67-e009-43bc-b697-aa37ff3b02a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d2b3b1-c10b-4bd9-8ba3-42863b6a47a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d2b3b1-c10b-4bd9-8ba3-42863b6a47a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2bfe337-135b-4ba2-b658-6112500370d7', 'volume_name': 'volume-a2bfe337-135b-4ba2-b658-6112500370d7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d44b6d8-df65-4d59-b9c2-1970753ddce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d44b6d8-df65-4d59-b9c2-1970753ddce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ccf0b6-8694-4a4d-bee6-4abf49743b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Volume a2bfe337-135b-4ba2-b658-6112500370d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2bfe337-135b-4ba2-b658-6112500370d7', 'volume_size': 1} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:53 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab 1073741824" returned: 0 in 0.745s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:53 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab Sep 30 19:47:53 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (03bb109f-e8de-4eb1-a569-6c1748db9f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9650bf34-efb4-481c-866d-e7f7fcea5df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9650bf34-efb4-481c-866d-e7f7fcea5df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1295431396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512aa46f-4877-4ce0-8e54-355e5f495eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:54Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22cc4bf-0c57-415b-8b47-b84a0620b45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22cc4bf-0c57-415b-8b47-b84a0620b45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbc9f32-545a-4e4e-ae84-46ea8a942d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbc9f32-545a-4e4e-ae84-46ea8a942d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512aa46f-4877-4ce0-8e54-355e5f495eea', 'volume_name': 'volume-512aa46f-4877-4ce0-8e54-355e5f495eea', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d680f8a7-fbce-4b95-a49a-ca07c486b453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d680f8a7-fbce-4b95-a49a-ca07c486b453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f42211-a49a-4880-abe8-0d46c9134ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:54 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Volume 512aa46f-4877-4ce0-8e54-355e5f495eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512aa46f-4877-4ce0-8e54-355e5f495eea', 'volume_size': 1} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:54 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab" returned: 0 in 0.368s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.970s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1505074521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d1afcb-524a-4927-ba88-2ddb8b6b0839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:53Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Creating volume 88d1afcb-524a-4927-ba88-2ddb8b6b0839 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:47:54 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:47:54 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "cinder-067cb8d9-d851-45dc-b6a1-8d984f20127c-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508" returned: 0 in 0.646s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:54 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 1073741824 Sep 30 19:47:54 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e90574b-500a-4b79-ab06-290983a07ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d51162-a8a3-4330-be34-c355fddf7eab', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55ce654-1cb9-4924-a5cc-23aa2ac9df6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:54 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508 Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-067cb8d9-d851-45dc-b6a1-8d984f20127c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:54 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:54 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Volume volume-65d51162-a8a3-4330-be34-c355fddf7eab (65d51162-a8a3-4330-be34-c355fddf7eab): created successfully Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55ce654-1cb9-4924-a5cc-23aa2ac9df6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (0b3a3f2b-df8d-4972-9a22-18f97b0db544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:54 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-828e6923-22bf-42cd-83d3-7fb48e1fd709 tempest-CreateVolumesFromImageTest-1648426941 None] Created volume successfully. Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "cinder-quobyte-067cb8d9-d851-45dc-b6a1-8d984f20127c" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-067cb8d9-d851-45dc-b6a1-8d984f20127c" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73a069b-3350-4ba2-95ad-0bc85bfc1ecb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:54 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c Sep 30 19:47:54 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:54 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.b4404a2f-2530-4abd-aaee-5a9d4d134508" returned: 0 in 0.303s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-b4404a2f-2530-4abd-aaee-5a9d4d134508" released by "_delete_snapshot" :: held 2.590s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" released by "delete_snapshot" :: held 2.662s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Created reservations ['45b37865-f332-44dd-9b2b-417ac1f81af1', '9be60454-0f1b-4833-b310-8bc151164cde', '71f51efa-bc63-43b6-8569-daf66b83a0a1', '2ff87d17-e73d-4fdd-8413-0d20b41646ee'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:54 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 1073741824" returned: 0 in 0.502s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:54 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Delete snapshot completed successfully. Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7895205e-c67d-45d6-8277-77051d7cd925 tempest-SnapshotsActionsTest-831561686 None] Lock "cinder-b4404a2f-2530-4abd-aaee-5a9d4d134508-delete_snapshot" released by "delete_snapshot" :: held 2.869s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:54 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 Sep 30 19:47:54 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:54 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c" returned: 0 in 0.418s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:54 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c Sep 30 19:47:54 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:55 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839" returned: 0 in 0.280s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.328s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-463625852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bfe337-135b-4ba2-b658-6112500370d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:54Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Creating volume a2bfe337-135b-4ba2-b658-6112500370d7 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:47:55 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:55 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-067cb8d9-d851-45dc-b6a1-8d984f20127c" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:55 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7 1073741824 Sep 30 19:47:55 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b38d555-e7b0-4f7f-8195-f86ab36f1a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd9b951-7669-41cf-b611-95bd6b18f7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-067cb8d9-d851-45dc-b6a1-8d984f20127c" released by "delete_volume" :: held 0.767s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:55 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Volume volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 (88d1afcb-524a-4927-ba88-2ddb8b6b0839): created successfully Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd9b951-7669-41cf-b611-95bd6b18f7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (d30923b6-fdb7-4783-8c65-73f3918c5296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d1b36a32-9cb0-4e47-9a24-9f4d42401341 tempest-CreateVolumesFromImageTest-1648426941 None] Created volume successfully. Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Created reservations ['30536ca1-ea54-418a-ba6a-b5ff6760d513', 'b9bc7788-cfce-45dc-94fc-d5014eb2c804', '19a502f8-fe3f-4e58-8780-f01466d941e2', '007c7ffb-a781-4cbe-93f1-903bbbc75927'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:55 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:47:55 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "cinder-cacd01b9-5dad-4178-9b75-33a31abdce90-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-cacd01b9-5dad-4178-9b75-33a31abdce90-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "cinder-quobyte-cacd01b9-5dad-4178-9b75-33a31abdce90" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-cacd01b9-5dad-4178-9b75-33a31abdce90" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45dc6b7-7f58-46f3-8429-ebf97bca1408]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "cinder-e49ffbc1-f06c-405f-a7a1-b21b2ae77b79-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-e49ffbc1-f06c-405f-a7a1-b21b2ae77b79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:55 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.363s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "cinder-quobyte-e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Deleted volume successfully. Sep 30 19:47:55 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7 1073741824" returned: 0 in 0.634s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:55 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 Sep 30 19:47:55 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-quobyte-e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Deleting offline snapshot e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 of volume f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] snapshot_file for this snap is: volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-1bbf53a6-0e4d-4752-a4ab-3d7a258cac41 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-067cb8d9-d851-45dc-b6a1-8d984f20127c-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a04b1be-16b3-49e1-a2dc-84d6aed1fdce]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:55 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7 Sep 30 19:47:55 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:55 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:47:55 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:56 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90" returned: 0 in 0.429s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:56 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90 Sep 30 19:47:56 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:56 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7" returned: 0 in 0.262s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1295431396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512aa46f-4877-4ce0-8e54-355e5f495eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3984bab236e44d4e9ef289f883b5061e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:47:54Z,use_quota=True,user_id='440cd760582d4d06a1c7f7c5bc3bd94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Creating volume 512aa46f-4877-4ce0-8e54-355e5f495eea {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:47:56 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ccf0b6-8694-4a4d-bee6-4abf49743b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2bfe337-135b-4ba2-b658-6112500370d7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c77dcb0-55d8-4c91-ab4d-f72e3b17d4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:56 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea 1073741824 Sep 30 19:47:56 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Volume volume-a2bfe337-135b-4ba2-b658-6112500370d7 (a2bfe337-135b-4ba2-b658-6112500370d7): created successfully Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c77dcb0-55d8-4c91-ab4d-f72e3b17d4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (501dce44-46f5-476a-a1e6-a77769352b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-be564453-94f8-4798-b88b-0d7c5000ffd4 tempest-CreateVolumesFromImageTest-1648426941 None] Created volume successfully. Sep 30 19:47:56 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.441s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7a90461-1614-46e4-91d4-d2ae87151458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bcd01c-bb0c-4e6a-918d-44a23c95f105]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:56 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cacd01b9-5dad-4178-9b75-33a31abdce90" returned: 0 in 0.330s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-quobyte-cacd01b9-5dad-4178-9b75-33a31abdce90" released by "delete_volume" :: held 0.815s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:56 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 Sep 30 19:47:56 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Created reservations ['6f1472b0-41a4-45a0-8320-e4993df0a7ca', '2cd71aca-94e2-47c6-98ce-c4dbab6fdf35', 'c70bbc76-e4d8-4b2f-ad51-f029649b92bd', '025841a9-09da-40d8-a268-656eb894a34f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:56 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:47:56 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:56 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea 1073741824" returned: 0 in 0.561s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:56 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458" returned: 0 in 0.501s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:56 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea Sep 30 19:47:56 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:56 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:47:56 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:56 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.344s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:47:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Deleted volume successfully. Sep 30 19:47:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1b84d3-caa0-4896-933d-224c349d9693 tempest-SnapshotDependencyTests-595961359 None] Lock "cinder-cacd01b9-5dad-4178-9b75-33a31abdce90-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:57 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea" returned: 0 in 0.314s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f42211-a49a-4880-abe8-0d46c9134ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512aa46f-4877-4ce0-8e54-355e5f495eea', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754b39ba-d828-46a3-89ac-94f4b7098c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:47:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Volume volume-512aa46f-4877-4ce0-8e54-355e5f495eea (512aa46f-4877-4ce0-8e54-355e5f495eea): created successfully Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754b39ba-d828-46a3-89ac-94f4b7098c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Flow 'volume_create_manager' (03bb109f-e8de-4eb1-a569-6c1748db9f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:47:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8b433652-e30f-4dd0-a0d1-5bc937af7379 tempest-CreateVolumesFromImageTest-1648426941 None] Created volume successfully. Sep 30 19:47:57 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.402s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:57 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79 Sep 30 19:47:57 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:57 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458.e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" returned: 0 in 0.269s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-512aa46f-4877-4ce0-8e54-355e5f495eea-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-quobyte-e49ffbc1-f06c-405f-a7a1-b21b2ae77b79" released by "_delete_snapshot" :: held 1.788s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" released by "delete_snapshot" :: held 1.836s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-512aa46f-4877-4ce0-8e54-355e5f495eea-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-quobyte-512aa46f-4877-4ce0-8e54-355e5f495eea" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-512aa46f-4877-4ce0-8e54-355e5f495eea" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Created reservations ['693cd8c1-f66c-4c8a-abae-d2412d20bd1c', '12976c6a-5990-4a60-9df7-49dc2aeff805', '35996729-30d5-47ea-98e4-a0c87928dedb', '620119a6-d371-4a5f-89b7-575b3de5dee6'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b9d578-8971-4907-8142-51661319a72a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Delete snapshot completed successfully. Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fa06448c-af69-46d8-8a92-7ac2f631997b tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-e49ffbc1-f06c-405f-a7a1-b21b2ae77b79-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:57 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea Sep 30 19:47:57 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "cinder-f7a90461-1614-46e4-91d4-d2ae87151458-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-f7a90461-1614-46e4-91d4-d2ae87151458-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:58 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea" returned: 0 in 0.412s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8708b28e-273e-4453-815f-ccf7f6a9f9ec]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:58 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea Sep 30 19:47:58 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:58 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 Sep 30 19:47:58 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:58 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-512aa46f-4877-4ce0-8e54-355e5f495eea" returned: 0 in 0.305s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-512aa46f-4877-4ce0-8e54-355e5f495eea" released by "delete_volume" :: held 0.768s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Created reservations ['806a64b2-5654-457c-ba76-081f37e500c4', '29d430f1-0e67-4097-ac69-2f63a9c664f3', '9460d5d7-676e-4a45-a545-50b471bbf28f', 'b97d3afe-5cd1-427a-8158-3d741c639702'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:58 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458" returned: 0 in 0.409s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:58 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458 Sep 30 19:47:58 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:58 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:47:58 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-a2bfe337-135b-4ba2-b658-6112500370d7-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-a2bfe337-135b-4ba2-b658-6112500370d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-quobyte-a2bfe337-135b-4ba2-b658-6112500370d7" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-a2bfe337-135b-4ba2-b658-6112500370d7" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76924ed-71d0-4db8-91e0-b053c79b42c0]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:58 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f7a90461-1614-46e4-91d4-d2ae87151458" returned: 0 in 0.340s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-quobyte-f7a90461-1614-46e4-91d4-d2ae87151458" released by "delete_volume" :: held 0.845s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:58 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.355s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:47:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Deleted volume successfully. Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09c24a81-3ea2-41ae-bc6d-35623d0ba62b tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-512aa46f-4877-4ce0-8e54-355e5f495eea-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:58 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Created reservations ['ec4621ce-77fb-4527-86fd-2acdfb0a5d7c', 'ad033fc4-2c71-4716-991b-777b9c04c5a4', 'c18af474-2ee3-4e6a-8726-381ef0d577ca', 'a7975441-2d91-4504-8154-4d0610384c6d'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:59 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7 Sep 30 19:47:59 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:59 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:47:59 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:59 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7" returned: 0 in 0.471s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:59 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7 Sep 30 19:47:59 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:59 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.363s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:47:59 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Deleted volume successfully. Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6c24df65-4118-4e4f-8133-246d49bc1613 tempest-SnapshotsActionsTest-300237177 None] Lock "cinder-f7a90461-1614-46e4-91d4-d2ae87151458-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:59 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a2bfe337-135b-4ba2-b658-6112500370d7" returned: 0 in 0.365s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-a2bfe337-135b-4ba2-b658-6112500370d7" released by "delete_volume" :: held 0.901s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Created reservations ['1c6a30f7-a770-4073-9e95-9e1a244a3557', '0cea8500-8d7a-4aa8-b31b-a5a2235b905f', '46152ba5-bff6-457b-bef0-61fc09029343', '5fa346f6-0a86-47aa-b779-20fc13529f13'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:47:59 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:47:59 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:47:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-88d1afcb-524a-4927-ba88-2ddb8b6b0839-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-88d1afcb-524a-4927-ba88-2ddb8b6b0839-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-quobyte-88d1afcb-524a-4927-ba88-2ddb8b6b0839" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-88d1afcb-524a-4927-ba88-2ddb8b6b0839" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dace733-3568-4581-9bd9-d24fc5ea8219]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:00 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.353s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Deleted volume successfully. Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-aa6d061d-34c9-4fc2-879f-b66394a55b37 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-a2bfe337-135b-4ba2-b658-6112500370d7-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:00 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 Sep 30 19:48:00 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:00 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839" returned: 0 in 0.521s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:00 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839 Sep 30 19:48:00 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:01 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-88d1afcb-524a-4927-ba88-2ddb8b6b0839" returned: 0 in 0.349s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-88d1afcb-524a-4927-ba88-2ddb8b6b0839" released by "delete_volume" :: held 0.953s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Created reservations ['b20be2d0-d04a-45c3-900b-84a5be8e1c80', '35d8b377-2c97-47c4-ac9c-ec5ef8de2a44', '8ca5a567-08d4-4d64-bcfd-03c74688e0ba', 'd0d411b1-e11c-4903-bb67-d47afeae5917'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:01 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:01 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:01 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.318s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:01 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Deleted volume successfully. Sep 30 19:48:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-87fb6e44-d6ab-44db-9bb5-68fe37790f11 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-88d1afcb-524a-4927-ba88-2ddb8b6b0839-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-65d51162-a8a3-4330-be34-c355fddf7eab-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-65d51162-a8a3-4330-be34-c355fddf7eab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-quobyte-65d51162-a8a3-4330-be34-c355fddf7eab" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-65d51162-a8a3-4330-be34-c355fddf7eab" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:02 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefbd2fd-b3d9-4195-ba9e-ab0871283a4b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:02 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab Sep 30 19:48:02 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:02 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab" returned: 0 in 0.466s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:02 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab Sep 30 19:48:02 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:03 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-65d51162-a8a3-4330-be34-c355fddf7eab" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-65d51162-a8a3-4330-be34-c355fddf7eab" released by "delete_volume" :: held 0.778s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Created reservations ['31a11496-51f9-4868-a38c-19a35932e6ad', '805f7fe3-38ac-494a-8ae6-c30f665ff811', 'dac928cc-cd07-4011-9cfd-65b90feb7ceb', '4edabb7d-58db-4bae-bb83-3a108e78b114'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:03 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:03 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-c8da5cd3-8dbe-4443-937e-9023e3b5d65b-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-c8da5cd3-8dbe-4443-937e-9023e3b5d65b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "cinder-quobyte-c8da5cd3-8dbe-4443-937e-9023e3b5d65b" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-c8da5cd3-8dbe-4443-937e-9023e3b5d65b" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:03 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.343s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Deleted volume successfully. Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e442a2c-94f8-4f6d-9160-18160a7ead9a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-54cc695b-ab20-4322-a2ba-4566f5e5fd2c tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-65d51162-a8a3-4330-be34-c355fddf7eab-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:03 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b Sep 30 19:48:03 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:04 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b" returned: 0 in 0.429s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:04 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b Sep 30 19:48:04 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:04 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c8da5cd3-8dbe-4443-937e-9023e3b5d65b" returned: 0 in 0.267s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-quobyte-c8da5cd3-8dbe-4443-937e-9023e3b5d65b" released by "delete_volume" :: held 0.779s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Created reservations ['a21bef49-68e9-4f9f-8fbe-5a36960c37da', '39684cde-f494-4a54-a6e4-1ddfb16525db', 'ced2e981-e94e-4516-b023-03aefd5c2f55', '615adea1-9f38-4c80-96bc-422b96561e38'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:04 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:04 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:04 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.356s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:04 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:04 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Deleted volume successfully. Sep 30 19:48:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f86f844c-62a4-4b46-8cd4-0d2f1b8b1ec7 tempest-CreateVolumesFromImageTest-1648426941 None] Lock "cinder-c8da5cd3-8dbe-4443-937e-9023e3b5d65b-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Flow 'volume_create_manager' (d8a595a1-abc6-4771-bbcd-95a7c0dfaee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e029f2f-5e8f-4cfb-bacf-a9bc5c8c306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e029f2f-5e8f-4cfb-bacf-a9bc5c8c306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-551504687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41a083d-ddb0-4378-a3ba-007060499593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05f1450fbab44aea722e3d611694d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:07Z,use_quota=True,user_id='8aa53027ca4f4953963a96be3e6e54d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2c23fa4-f91b-4e33-9e19-ed889460cb58),volume_type_id=e2c23fa4-f91b-4e33-9e19-ed889460cb58)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da79f420-57a4-48a9-b3fb-7cd3e54e5de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da79f420-57a4-48a9-b3fb-7cd3e54e5de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a9cdd4-df90-4935-9003-6039f7adaca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a9cdd4-df90-4935-9003-6039f7adaca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41a083d-ddb0-4378-a3ba-007060499593', 'volume_name': 'volume-a41a083d-ddb0-4378-a3ba-007060499593', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267ce03d-bfec-45ad-9f56-00a3a5ca821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267ce03d-bfec-45ad-9f56-00a3a5ca821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d68ecf-98b5-4e42-8b91-bb1c24283a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:06 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Volume a41a083d-ddb0-4378-a3ba-007060499593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41a083d-ddb0-4378-a3ba-007060499593', 'volume_size': 1} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-551504687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41a083d-ddb0-4378-a3ba-007060499593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05f1450fbab44aea722e3d611694d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:07Z,use_quota=True,user_id='8aa53027ca4f4953963a96be3e6e54d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2c23fa4-f91b-4e33-9e19-ed889460cb58),volume_type_id=e2c23fa4-f91b-4e33-9e19-ed889460cb58)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Creating volume a41a083d-ddb0-4378-a3ba-007060499593 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:06 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:07 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593 1073741824 Sep 30 19:48:07 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:07 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593 1073741824" returned: 0 in 0.514s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:07 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593 Sep 30 19:48:07 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:07 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593" returned: 0 in 0.270s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d68ecf-98b5-4e42-8b91-bb1c24283a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41a083d-ddb0-4378-a3ba-007060499593', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d6d109-edd0-4997-9518-65b1220825c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:07 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Volume volume-a41a083d-ddb0-4378-a3ba-007060499593 (a41a083d-ddb0-4378-a3ba-007060499593): created successfully Sep 30 19:48:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d6d109-edd0-4997-9518-65b1220825c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Flow 'volume_create_manager' (d8a595a1-abc6-4771-bbcd-95a7c0dfaee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a39796dc-b2b8-4f78-8c98-e1ef1dcb4e74 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Created volume successfully. Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (9872bcc6-1db4-4cdc-be31-0e4595adc005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cacc660-7fce-4dc9-81e6-2ee655785492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cacc660-7fce-4dc9-81e6-2ee655785492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-842822142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb6860c-b725-43a1-8d47-9b478a05455f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:09Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065baf50-be31-456d-a2b2-59ebf310cdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065baf50-be31-456d-a2b2-59ebf310cdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4208524d-4306-400d-b7ee-58f4dd7f283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4208524d-4306-400d-b7ee-58f4dd7f283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb6860c-b725-43a1-8d47-9b478a05455f', 'volume_name': 'volume-1eb6860c-b725-43a1-8d47-9b478a05455f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e8492d-fb7b-4a81-9b99-6a533bf0243e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e8492d-fb7b-4a81-9b99-6a533bf0243e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2f7540-71c8-4667-b1aa-08e6aa82d363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:08 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume 1eb6860c-b725-43a1-8d47-9b478a05455f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb6860c-b725-43a1-8d47-9b478a05455f', 'volume_size': 1} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-842822142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb6860c-b725-43a1-8d47-9b478a05455f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:09Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Creating volume 1eb6860c-b725-43a1-8d47-9b478a05455f {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:08 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:08 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f 1073741824 Sep 30 19:48:08 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:09 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f 1073741824" returned: 0 in 0.563s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-524a7853-26e2-44d2-9820-bc9a127eb446 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-524a7853-26e2-44d2-9820-bc9a127eb446 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-524a7853-26e2-44d2-9820-bc9a127eb446 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-524a7853-26e2-44d2-9820-bc9a127eb446 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-524a7853-26e2-44d2-9820-bc9a127eb446 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-524a7853-26e2-44d2-9820-bc9a127eb446 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:09 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:09 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:09 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f Sep 30 19:48:09 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:09 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-524a7853-26e2-44d2-9820-bc9a127eb446 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.263s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-524a7853-26e2-44d2-9820-bc9a127eb446 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-524a7853-26e2-44d2-9820-bc9a127eb446 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Retype volume completed successfully. Sep 30 19:48:09 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f" returned: 0 in 0.269s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2f7540-71c8-4667-b1aa-08e6aa82d363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb6860c-b725-43a1-8d47-9b478a05455f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec0d1db-3b43-4f99-9c1a-04d7c77a468a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:09 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume volume-1eb6860c-b725-43a1-8d47-9b478a05455f (1eb6860c-b725-43a1-8d47-9b478a05455f): created successfully Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec0d1db-3b43-4f99-9c1a-04d7c77a468a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (9872bcc6-1db4-4cdc-be31-0e4595adc005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e95ffade-05e6-4165-bdd0-a918a7df7e7f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created volume successfully. Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Acquiring lock "cinder-a41a083d-ddb0-4378-a3ba-007060499593-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "cinder-a41a083d-ddb0-4378-a3ba-007060499593-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Acquiring lock "cinder-quobyte-a41a083d-ddb0-4378-a3ba-007060499593" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "cinder-quobyte-a41a083d-ddb0-4378-a3ba-007060499593" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[463fc5a1-e2ce-490f-a3a2-ac59b282fc0c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:10 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593 Sep 30 19:48:10 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Creating offline snapshot bc060755-daf0-4514-b600-bc4712989855 of volume 1eb6860c-b725-43a1-8d47-9b478a05455f {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73aa883-30d4-4626-89ff-3272a0743998]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:11 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593" returned: 0 in 0.388s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:11 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593 Sep 30 19:48:11 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:11 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f Sep 30 19:48:11 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:11 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a41a083d-ddb0-4378-a3ba-007060499593" returned: 0 in 0.258s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "cinder-quobyte-a41a083d-ddb0-4378-a3ba-007060499593" released by "delete_volume" :: held 0.686s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:11 devstack cinder-volume[87426]: WARNING cinder.quota [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:48:11 devstack cinder-volume[87426]: WARNING cinder.quota [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Created reservations ['ea667afd-bae2-4f84-8406-51666ded8ae4', 'b7b87b41-d86a-467d-a543-d00a712da80f', '99ed5f7c-7edb-464b-9d5f-1fc44602661c', 'e76fc53e-17d3-4d90-b1a5-b65e57641377'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:11 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f" returned: 0 in 0.384s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:11 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 1G Sep 30 19:48:11 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:11 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:11 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:11 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.277s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:11 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Deleted volume successfully. Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-459e5283-9fc8-435f-904e-4c6450d7bee7 tempest-VolumeRetypeWithoutMigrationTest-913114980 None] Lock "cinder-a41a083d-ddb0-4378-a3ba-007060499593-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:11 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 1G" returned: 0 in 0.493s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb6860c-b725-43a1-8d47-9b478a05455f -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:11 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb6860c-b725-43a1-8d47-9b478a05455f -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 Sep 30 19:48:11 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:12 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb6860c-b725-43a1-8d47-9b478a05455f -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855" returned: 0 in 0.360s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:12 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 is being set with open permissions: ugo+rw Sep 30 19:48:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:12 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 Sep 30 19:48:12 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:12 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855" returned: 0 in 0.277s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:12 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.info Sep 30 19:48:12 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:12 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.info" returned: 0 in 0.314s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:12 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.info is being set with open permissions: ugo+rw Sep 30 19:48:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:12 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.info Sep 30 19:48:12 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:13 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.info" returned: 0 in 0.427s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:13 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6ff00134-f9f8-49d9-ab28-5e8d58c9ab5a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Create snapshot completed successfully Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (c3fd1ee1-1d1e-400e-a203-d6d314c43e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1316e529-ff32-4bcc-b993-07cb41a7d720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1316e529-ff32-4bcc-b993-07cb41a7d720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879802981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b07195-2b3b-46f2-8cce-bd2960fce93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:15Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d354832-223b-4177-98e0-dcc3c1809de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d354832-223b-4177-98e0-dcc3c1809de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29bcbb0-f11f-4c31-b9fa-c2fbbd92c6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29bcbb0-f11f-4c31-b9fa-c2fbbd92c6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b07195-2b3b-46f2-8cce-bd2960fce93a', 'volume_name': 'volume-07b07195-2b3b-46f2-8cce-bd2960fce93a', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a4eaa5-1d5a-4073-b1fe-fc1a8bfb8304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a4eaa5-1d5a-4073-b1fe-fc1a8bfb8304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f391a856-f12e-4aaf-82ab-7d31d90d16b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:14 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume 07b07195-2b3b-46f2-8cce-bd2960fce93a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b07195-2b3b-46f2-8cce-bd2960fce93a', 'volume_size': 1} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879802981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b07195-2b3b-46f2-8cce-bd2960fce93a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:15Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Creating volume 07b07195-2b3b-46f2-8cce-bd2960fce93a {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:14 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:15 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a 1073741824 Sep 30 19:48:15 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:15 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-8565751e-d9ff-4b97-b9ba-5cb4775b1cf9 tempest-TestShelveInstance-399002775 None] Terminate volume connection completed successfully. Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-8565751e-d9ff-4b97-b9ba-5cb4775b1cf9 tempest-TestShelveInstance-399002775 None] Deleting attachment ee8c5f0f-b5f0-496f-98ed-75e462790f66. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (87f91c17-8c5a-432c-871b-b1a5e70a4ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761fa51d-e612-44eb-979f-63331c9d11bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761fa51d-e612-44eb-979f-63331c9d11bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877209578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cb3ce0-85a1-45df-8900-3449b68c52b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:15Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efddd37e-0df9-48b0-96ae-ae2c920e3da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efddd37e-0df9-48b0-96ae-ae2c920e3da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901558b3-a18a-49d6-afa5-500a23a331ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901558b3-a18a-49d6-afa5-500a23a331ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02cb3ce0-85a1-45df-8900-3449b68c52b7', 'volume_name': 'volume-02cb3ce0-85a1-45df-8900-3449b68c52b7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0666955-5eea-444b-bbd9-90cef2a1e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0666955-5eea-444b-bbd9-90cef2a1e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fba26c-ba42-441e-9e8b-0b39e311ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:15 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume 02cb3ce0-85a1-45df-8900-3449b68c52b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02cb3ce0-85a1-45df-8900-3449b68c52b7', 'volume_size': 1} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Acquiring lock "cinder-66f7d6ce-9bd0-4d82-be90-19941f255622-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Lock "cinder-66f7d6ce-9bd0-4d82-be90-19941f255622-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=136,cinder:UPDATE=155,cinder:DELETE=14,cinder:INSERT=35 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:48:15 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a 1073741824" returned: 0 in 0.869s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Acquiring lock "cinder-quobyte-66f7d6ce-9bd0-4d82-be90-19941f255622" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Lock "cinder-quobyte-66f7d6ce-9bd0-4d82-be90-19941f255622" acquired by "delete_volume" :: waited 0.034s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd58f471-2b14-46e8-ba05-35cc71f2239f]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:16 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a Sep 30 19:48:16 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (dd1d3e69-bbe8-4cbe-9403-8acc3529e255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28578976-ca0b-481a-a1e8-856af0824a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28578976-ca0b-481a-a1e8-856af0824a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1851657854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc292887-19ed-45bf-a273-48d6bc7baf19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:16Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd207a5-7131-438f-acb3-9066739a71ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd207a5-7131-438f-acb3-9066739a71ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bbb1a0-61e2-4ca6-be22-2ef57ff64f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bbb1a0-61e2-4ca6-be22-2ef57ff64f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc292887-19ed-45bf-a273-48d6bc7baf19', 'volume_name': 'volume-cc292887-19ed-45bf-a273-48d6bc7baf19', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6e7ace-28be-457e-bb8f-5917c780a82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6e7ace-28be-457e-bb8f-5917c780a82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5339e47-f5ff-4f15-a983-b0ef82f35b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume cc292887-19ed-45bf-a273-48d6bc7baf19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc292887-19ed-45bf-a273-48d6bc7baf19', 'volume_size': 1} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:16 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 Sep 30 19:48:16 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:16 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a" returned: 0 in 0.441s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877209578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cb3ce0-85a1-45df-8900-3449b68c52b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:15Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Creating volume 02cb3ce0-85a1-45df-8900-3449b68c52b7 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:16 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:16 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 1073741824 Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f391a856-f12e-4aaf-82ab-7d31d90d16b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b07195-2b3b-46f2-8cce-bd2960fce93a', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:16 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a341ce8b-fa86-45cd-aed4-07b7492fbb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume volume-07b07195-2b3b-46f2-8cce-bd2960fce93a (07b07195-2b3b-46f2-8cce-bd2960fce93a): created successfully Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a341ce8b-fa86-45cd-aed4-07b7492fbb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (c3fd1ee1-1d1e-400e-a203-d6d314c43e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8fb8219e-beb8-4e8d-badd-5f4164046159 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created volume successfully. Sep 30 19:48:16 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622" returned: 0 in 0.750s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:16 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622 Sep 30 19:48:16 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (249bc914-63e8-4065-86a9-925bdf04902c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31945498-c3ad-4a62-a3c8-8d05a8023e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31945498-c3ad-4a62-a3c8-8d05a8023e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1225206168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50c2304-80d0-420b-b1e4-f535fb2a4ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:17Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12e47ed-00a1-4962-9af9-fa21001a1efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12e47ed-00a1-4962-9af9-fa21001a1efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7e3b09-14dc-4430-ad87-df452cf97332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7e3b09-14dc-4430-ad87-df452cf97332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50c2304-80d0-420b-b1e4-f535fb2a4ea1', 'volume_name': 'volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76b5051-feda-4a8c-a780-bdc7649ece9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76b5051-feda-4a8c-a780-bdc7649ece9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4b1f96-befb-4f75-8e35-0dbc52bed9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:17 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume b50c2304-80d0-420b-b1e4-f535fb2a4ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1', 'volume_size': 1} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:17 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66f7d6ce-9bd0-4d82-be90-19941f255622" returned: 0 in 0.446s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:17 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 1073741824" returned: 0 in 0.771s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Lock "cinder-quobyte-66f7d6ce-9bd0-4d82-be90-19941f255622" released by "delete_volume" :: held 1.285s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:17 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 Sep 30 19:48:17 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.quota [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Created reservations ['dc84be32-4562-44cf-bc0e-143fc848cb85', 'deb93d4e-36f7-4679-8090-d5aa27a5f017', '0a1a52a4-8f72-4816-94a1-e252c98652c0', '47f4d232-296d-4fcf-80d1-957567eea646'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:17 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:17 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (ea6d9827-a4cd-489c-841d-23be73858937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99847866-f866-45cb-918c-64f7f524eaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:17 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7" returned: 0 in 0.378s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1851657854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc292887-19ed-45bf-a273-48d6bc7baf19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:16Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Creating volume cc292887-19ed-45bf-a273-48d6bc7baf19 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:17 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99847866-f866-45cb-918c-64f7f524eaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-649538071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635ecd3c-a033-4aef-8531-b5a2dd274ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:18Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722796a6-39d0-40cb-aadc-7e08759da683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722796a6-39d0-40cb-aadc-7e08759da683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162a0bdb-6b76-46b5-9c43-b40363e5370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162a0bdb-6b76-46b5-9c43-b40363e5370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635ecd3c-a033-4aef-8531-b5a2dd274ac6', 'volume_name': 'volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:17 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19 1073741824 Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b509dabf-9900-4e57-966c-462c285516fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:17 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b509dabf-9900-4e57-966c-462c285516fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e345c613-ac87-4d7f-9057-40226ab4db7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:17 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume 635ecd3c-a033-4aef-8531-b5a2dd274ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6', 'volume_size': 1} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fba26c-ba42-441e-9e8b-0b39e311ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02cb3ce0-85a1-45df-8900-3449b68c52b7', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cbc3c8-3fd5-40c9-a0bb-47232b16cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:17 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 (02cb3ce0-85a1-45df-8900-3449b68c52b7): created successfully Sep 30 19:48:17 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cbc3c8-3fd5-40c9-a0bb-47232b16cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (87f91c17-8c5a-432c-871b-b1a5e70a4ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.346s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.manager [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:17 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Deleted volume successfully. Sep 30 19:48:17 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-07ea7fea-eb7c-4437-85d4-0f47d6d1fa33 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created volume successfully. Sep 30 19:48:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [req-4a17f5e7-d82b-4e88-b44e-1f2a45f317cb req-f04808aa-85dd-412b-9d23-665fdc255b01 tempest-TestShelveInstance-399002775 None] Lock "cinder-66f7d6ce-9bd0-4d82-be90-19941f255622-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:18 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19 1073741824" returned: 0 in 0.677s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:18 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19 Sep 30 19:48:18 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:18 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19" returned: 0 in 0.290s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.634s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1225206168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50c2304-80d0-420b-b1e4-f535fb2a4ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:17Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Creating volume b50c2304-80d0-420b-b1e4-f535fb2a4ea1 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:18 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5339e47-f5ff-4f15-a983-b0ef82f35b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc292887-19ed-45bf-a273-48d6bc7baf19', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:18 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 1073741824 Sep 30 19:48:18 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ff81bd-2fb9-49b9-b578-9f80dda9b12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:18 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume volume-cc292887-19ed-45bf-a273-48d6bc7baf19 (cc292887-19ed-45bf-a273-48d6bc7baf19): created successfully Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ff81bd-2fb9-49b9-b578-9f80dda9b12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (dd1d3e69-bbe8-4cbe-9403-8acc3529e255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-76614c26-d893-47f1-8cfa-498164396e3f tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created volume successfully. Sep 30 19:48:19 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 1073741824" returned: 0 in 0.510s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:19 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 Sep 30 19:48:19 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:19 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-649538071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635ecd3c-a033-4aef-8531-b5a2dd274ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fdca4ad502349f0a8414e1a10e1d604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:18Z,use_quota=True,user_id='191425342a14484e9043dc6fcc4edffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Creating volume 635ecd3c-a033-4aef-8531-b5a2dd274ac6 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:19 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4b1f96-befb-4f75-8e35-0dbc52bed9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:19 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 1073741824 Sep 30 19:48:19 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ad2606-2960-4d45-866b-aaeea544c786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:19 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 (b50c2304-80d0-420b-b1e4-f535fb2a4ea1): created successfully Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ad2606-2960-4d45-866b-aaeea544c786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (249bc914-63e8-4065-86a9-925bdf04902c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:19 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-831c510f-b561-4c5c-b521-ed482cd8f8ec tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created volume successfully. Sep 30 19:48:20 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 1073741824" returned: 0 in 0.576s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:20 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 Sep 30 19:48:20 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:20 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6" returned: 0 in 0.261s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e345c613-ac87-4d7f-9057-40226ab4db7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3022848b-1a72-4920-9f61-5b1032dd740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:20 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Volume volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 (635ecd3c-a033-4aef-8531-b5a2dd274ac6): created successfully Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3022848b-1a72-4920-9f61-5b1032dd740c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Flow 'volume_create_manager' (ea6d9827-a4cd-489c-841d-23be73858937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fd64eea7-6acb-4ebd-b39d-d3591dbd6401 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created volume successfully. Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Flow 'volume_create_manager' (4398ce93-4e35-4f53-969e-18bc82bc7347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42168ae3-0cc5-4dc4-a0ba-454a8521c095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42168ae3-0cc5-4dc4-a0ba-454a8521c095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1124225009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4976d4e-b3b9-4b32-a887-c6510d8099e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecc0ba7aa4747398ffb6e6d9e033990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:21Z,use_quota=True,user_id='8d19db122b354dedb362c7533ccdcf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06597b4b-abdb-4804-bee0-636f4bb52204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06597b4b-abdb-4804-bee0-636f4bb52204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b196c06e-d895-4bd2-9cb2-a2ed53717e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b196c06e-d895-4bd2-9cb2-a2ed53717e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4976d4e-b3b9-4b32-a887-c6510d8099e4', 'volume_name': 'volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e93ed62-d46a-4719-add8-981a85447109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e93ed62-d46a-4719-add8-981a85447109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a84822-db76-4c6f-a0de-7eb805ef52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:20 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Volume c4976d4e-b3b9-4b32-a887-c6510d8099e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4', 'volume_size': 1} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1124225009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4976d4e-b3b9-4b32-a887-c6510d8099e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecc0ba7aa4747398ffb6e6d9e033990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:21Z,use_quota=True,user_id='8d19db122b354dedb362c7533ccdcf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Creating volume c4976d4e-b3b9-4b32-a887-c6510d8099e4 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:20 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:20 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 1073741824 Sep 30 19:48:20 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-635ecd3c-a033-4aef-8531-b5a2dd274ac6-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-635ecd3c-a033-4aef-8531-b5a2dd274ac6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-quobyte-635ecd3c-a033-4aef-8531-b5a2dd274ac6" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-635ecd3c-a033-4aef-8531-b5a2dd274ac6" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24c0a4d-2d50-4e95-a668-5a36f66d4d8a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:21 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 Sep 30 19:48:21 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:21 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 1073741824" returned: 0 in 0.525s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:21 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 Sep 30 19:48:21 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:21 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6" returned: 0 in 0.382s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:21 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6 Sep 30 19:48:21 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:21 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4" returned: 0 in 0.269s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a84822-db76-4c6f-a0de-7eb805ef52a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e594911d-5e01-4072-bad2-5108d63e09aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:21 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Volume volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 (c4976d4e-b3b9-4b32-a887-c6510d8099e4): created successfully Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e594911d-5e01-4072-bad2-5108d63e09aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Flow 'volume_create_manager' (4398ce93-4e35-4f53-969e-18bc82bc7347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:21 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-32380802-d811-440e-b949-5597f76febc4 tempest-VolumesServicesTestJSON-1263232230 None] Created volume successfully. Sep 30 19:48:21 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-635ecd3c-a033-4aef-8531-b5a2dd274ac6" returned: 0 in 0.256s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-635ecd3c-a033-4aef-8531-b5a2dd274ac6" released by "delete_volume" :: held 0.685s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created reservations ['e8fb7684-a474-44ba-9cee-2c9541e84452', '7d03acc2-6889-4a0a-8866-86de9baf9589', '35372fb4-9164-4351-a291-807c1211a67a', '8ca26f96-e196-4be2-bdf7-49ea4fd2e3e1'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:21 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:21 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-b50c2304-80d0-420b-b1e4-f535fb2a4ea1-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:22 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.332s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-b50c2304-80d0-420b-b1e4-f535fb2a4ea1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:22 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Deleted volume successfully. Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-70393df4-e092-49d7-aba7-13cf69f7d2df tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-635ecd3c-a033-4aef-8531-b5a2dd274ac6-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-quobyte-b50c2304-80d0-420b-b1e4-f535fb2a4ea1" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-b50c2304-80d0-420b-b1e4-f535fb2a4ea1" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa868c04-fe8c-48d1-a91c-4792ab29fef0]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:22 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 Sep 30 19:48:22 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:22 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1" returned: 0 in 0.407s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:22 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1 Sep 30 19:48:22 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Acquiring lock "cinder-c4976d4e-b3b9-4b32-a887-c6510d8099e4-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Lock "cinder-c4976d4e-b3b9-4b32-a887-c6510d8099e4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Acquiring lock "cinder-quobyte-c4976d4e-b3b9-4b32-a887-c6510d8099e4" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Lock "cinder-quobyte-c4976d4e-b3b9-4b32-a887-c6510d8099e4" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f269f6-eedd-488f-ad4d-f52dab2fb557]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:23 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b50c2304-80d0-420b-b1e4-f535fb2a4ea1" returned: 0 in 0.329s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-b50c2304-80d0-420b-b1e4-f535fb2a4ea1" released by "delete_volume" :: held 0.783s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=187,cinder:SELECT=147,cinder:INSERT=43,cinder:DELETE=16 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created reservations ['a0019340-0db1-4b52-9d89-e9c7a22af3a4', 'f56fa086-e76e-463a-a571-e973e8262c27', '5ca5441c-a609-4fe3-a47f-a9865cc90736', '08f2d050-2340-40c8-95c1-829f99175bc4'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:23 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 Sep 30 19:48:23 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:23 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:23 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-cc292887-19ed-45bf-a273-48d6bc7baf19-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-cc292887-19ed-45bf-a273-48d6bc7baf19-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-quobyte-cc292887-19ed-45bf-a273-48d6bc7baf19" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-cc292887-19ed-45bf-a273-48d6bc7baf19" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:23 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4" returned: 0 in 0.483s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e38127-74ae-4e90-bf96-aea5a3c88a92]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:23 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4 Sep 30 19:48:23 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:23 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.322s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:23 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Deleted volume successfully. Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-41d8c7c4-3379-469a-ad63-f54f15d59221 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-b50c2304-80d0-420b-b1e4-f535fb2a4ea1-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:23 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19 Sep 30 19:48:23 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:23 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4976d4e-b3b9-4b32-a887-c6510d8099e4" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Lock "cinder-quobyte-c4976d4e-b3b9-4b32-a887-c6510d8099e4" released by "delete_volume" :: held 0.833s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Created reservations ['afdf82af-c17f-49cc-b9fb-cd5a51048a43', '700b06f1-ab66-4372-8d83-5126fff72a6e', 'd59e249f-bfe2-4a32-918d-27d03b53bfc8', '3f275087-041d-4dd9-8707-ec60d8aa475b'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:23 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:23 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:24 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19" returned: 0 in 0.504s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:24 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:24 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:24 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19 Sep 30 19:48:24 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:24 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.368s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:48:24 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.328s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:24 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Deleted volume successfully. Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2fa676b7-0cc4-42a3-bdcf-ea142a920eb3 tempest-VolumesServicesTestJSON-1263232230 None] Lock "cinder-c4976d4e-b3b9-4b32-a887-c6510d8099e4-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:24 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cc292887-19ed-45bf-a273-48d6bc7baf19" returned: 0 in 0.366s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-cc292887-19ed-45bf-a273-48d6bc7baf19" released by "delete_volume" :: held 0.957s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created reservations ['46c43cd0-6a54-4f81-90b5-ddd7c6849cdb', '5581b31c-6df9-42a7-ad4e-0c9602458f1e', '5a872e26-2b17-4af5-b0c8-e99ed284a72e', 'ea8d5bf6-5f61-4992-9d72-cc73ebbac103'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:24 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:24 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:24 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.322s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:24 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Deleted volume successfully. Sep 30 19:48:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d8871c8-b447-499f-998b-6bf7e1d6d437 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-cc292887-19ed-45bf-a273-48d6bc7baf19-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-02cb3ce0-85a1-45df-8900-3449b68c52b7-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-02cb3ce0-85a1-45df-8900-3449b68c52b7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-quobyte-02cb3ce0-85a1-45df-8900-3449b68c52b7" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-02cb3ce0-85a1-45df-8900-3449b68c52b7" acquired by "delete_volume" :: waited 0.039s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:25 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52413f1-50c2-4be2-bcf3-36c43a2d6df6]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:25 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 Sep 30 19:48:25 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:26 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7" returned: 0 in 0.445s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:26 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7 Sep 30 19:48:26 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:26 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-02cb3ce0-85a1-45df-8900-3449b68c52b7" returned: 0 in 0.260s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-02cb3ce0-85a1-45df-8900-3449b68c52b7" released by "delete_volume" :: held 0.758s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created reservations ['d777723a-142a-446e-a3e5-71bf36b167f6', '76fc083c-182b-468d-94a1-8de40ea084c2', '1b645394-ccbe-436e-821c-8d6ff5e1383e', '4cb64965-1193-47b5-b781-3676f1ac6456'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:26 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:26 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-07b07195-2b3b-46f2-8cce-bd2960fce93a-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-07b07195-2b3b-46f2-8cce-bd2960fce93a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-quobyte-07b07195-2b3b-46f2-8cce-bd2960fce93a" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-07b07195-2b3b-46f2-8cce-bd2960fce93a" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f6ae48-deb8-4593-8bc0-bba45e322326]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:27 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.371s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Deleted volume successfully. Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c4ccb160-6c2f-4964-a8b1-60479f88ac0a tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-02cb3ce0-85a1-45df-8900-3449b68c52b7-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:27 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a Sep 30 19:48:27 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:27 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a" returned: 0 in 0.463s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:27 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a Sep 30 19:48:27 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:27 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07b07195-2b3b-46f2-8cce-bd2960fce93a" returned: 0 in 0.322s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-07b07195-2b3b-46f2-8cce-bd2960fce93a" released by "delete_volume" :: held 0.842s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:27 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created reservations ['60b0b2c7-52f7-4054-bd79-4de9116214c2', '37552843-520e-4357-9808-6d36515143b5', '4a5893ec-416b-4381-8ad8-6fd1e70d9eef', 'faa2afd3-bf72-4aa6-bd6a-1a726450f75f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:28 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:28 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-bc060755-daf0-4514-b600-bc4712989855-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-bc060755-daf0-4514-b600-bc4712989855-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-quobyte-1eb6860c-b725-43a1-8d47-9b478a05455f" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-1eb6860c-b725-43a1-8d47-9b478a05455f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-quobyte-bc060755-daf0-4514-b600-bc4712989855" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-bc060755-daf0-4514-b600-bc4712989855" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Deleting offline snapshot bc060755-daf0-4514-b600-bc4712989855 of volume 1eb6860c-b725-43a1-8d47-9b478a05455f {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] snapshot_file for this snap is: volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2533b3e0-00f0-404d-8536-3f8f2e9489b1]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:28 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.389s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Deleted volume successfully. Sep 30 19:48:28 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 Sep 30 19:48:28 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-503f49d9-28ae-4ba9-b762-5e3228b44d97 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-07b07195-2b3b-46f2-8cce-bd2960fce93a-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:28 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855" returned: 0 in 0.431s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb6860c-b725-43a1-8d47-9b478a05455f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7120604c-0425-4533-94b4-d946721abe45]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:28 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f Sep 30 19:48:28 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:29 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f" returned: 0 in 0.412s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:29 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 Sep 30 19:48:29 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:29 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855" returned: 0 in 0.402s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:29 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855 Sep 30 19:48:29 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:29 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f.bc060755-daf0-4514-b600-bc4712989855" returned: 0 in 0.302s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-bc060755-daf0-4514-b600-bc4712989855" released by "_delete_snapshot" :: held 1.713s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-1eb6860c-b725-43a1-8d47-9b478a05455f" released by "delete_snapshot" :: held 1.752s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created reservations ['57bce713-c1da-4c68-b0ee-4b8aaf3b31da', 'ea056a20-b196-4908-9bd5-6770fd788b37', 'ab5d1869-d1bd-4cd4-b531-c9f5f82bf24d', '1f7d2e98-9db5-44c3-9ab0-bce8df3fdf01'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Delete snapshot completed successfully. Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-df595175-6754-4867-ab58-b618194aec70 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-bc060755-daf0-4514-b600-bc4712989855-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-1eb6860c-b725-43a1-8d47-9b478a05455f-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-1eb6860c-b725-43a1-8d47-9b478a05455f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "cinder-quobyte-1eb6860c-b725-43a1-8d47-9b478a05455f" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-1eb6860c-b725-43a1-8d47-9b478a05455f" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc40826-32f9-42ba-98b2-7840042e2363]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:30 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f Sep 30 19:48:30 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:30 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f" returned: 0 in 0.414s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:31 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f Sep 30 19:48:31 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:31 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1eb6860c-b725-43a1-8d47-9b478a05455f" returned: 0 in 0.276s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-quobyte-1eb6860c-b725-43a1-8d47-9b478a05455f" released by "delete_volume" :: held 0.776s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Created reservations ['48dae8d3-d09f-47c3-a897-578abcd769b7', '9aaa3071-85ea-48c7-8288-eabcbe106125', '8ccca51d-6f83-46c9-be29-59aa57eab8c4', 'e1e8b53c-dce8-4db0-9384-2f17b199a8d4'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:31 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:31 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:31 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.308s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Deleted volume successfully. Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2e68d6b-4281-45da-b453-e00e9a029606 tempest-CreateVolumesFromSnapshotTest-1525369231 None] Lock "cinder-1eb6860c-b725-43a1-8d47-9b478a05455f-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Flow 'volume_create_manager' (d7ec7cb0-a2a4-40e5-9849-3fa24aa9612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c1df3a-4a93-4493-909d-f4c193df945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c1df3a-4a93-4493-909d-f4c193df945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1029829327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73d0062-9e6e-4906-a648-60fc3ff38e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2248c26fd54c49f9a4e95d1b7a53bbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:32Z,use_quota=True,user_id='2dab5e12d0f744d68f4bab27d070a321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6546920-d77a-4b4f-a07b-a5e84638e137),volume_type_id=a6546920-d77a-4b4f-a07b-a5e84638e137)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801ccc9e-2101-4cdc-bdf2-521049cf7021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801ccc9e-2101-4cdc-bdf2-521049cf7021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52df365d-f6f8-4f9a-a632-100420e84661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52df365d-f6f8-4f9a-a632-100420e84661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73d0062-9e6e-4906-a648-60fc3ff38e8a', 'volume_name': 'volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb6c8b1-1caf-4ed2-9bee-eb0d83df5eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb6c8b1-1caf-4ed2-9bee-eb0d83df5eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaf321e-0100-4a62-ac3a-4c0ea0c03d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:31 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Volume f73d0062-9e6e-4906-a648-60fc3ff38e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a', 'volume_size': 1} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1029829327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f73d0062-9e6e-4906-a648-60fc3ff38e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2248c26fd54c49f9a4e95d1b7a53bbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:32Z,use_quota=True,user_id='2dab5e12d0f744d68f4bab27d070a321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6546920-d77a-4b4f-a07b-a5e84638e137),volume_type_id=a6546920-d77a-4b4f-a07b-a5e84638e137)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Creating volume f73d0062-9e6e-4906-a648-60fc3ff38e8a {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:31 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:31 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a 1073741824 Sep 30 19:48:31 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:32 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a 1073741824" returned: 0 in 0.535s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:32 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a Sep 30 19:48:32 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:32 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a" returned: 0 in 0.307s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaf321e-0100-4a62-ac3a-4c0ea0c03d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a61849-5de4-4765-a119-6af9af83eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:32 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Volume volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a (f73d0062-9e6e-4906-a648-60fc3ff38e8a): created successfully Sep 30 19:48:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a61849-5de4-4765-a119-6af9af83eae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Flow 'volume_create_manager' (d7ec7cb0-a2a4-40e5-9849-3fa24aa9612c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:32 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-55ff0cdf-e347-44d6-a269-6167a7354d33 tempest-VolumeTypesAccessTest-418702714 None] Created volume successfully. Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Acquiring lock "cinder-f73d0062-9e6e-4906-a648-60fc3ff38e8a-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Lock "cinder-f73d0062-9e6e-4906-a648-60fc3ff38e8a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Acquiring lock "cinder-quobyte-f73d0062-9e6e-4906-a648-60fc3ff38e8a" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Lock "cinder-quobyte-f73d0062-9e6e-4906-a648-60fc3ff38e8a" acquired by "delete_volume" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f603af26-66d1-4a6b-afe4-36a2184d0f62]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:34 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a Sep 30 19:48:34 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:34 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a" returned: 0 in 0.420s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:34 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a Sep 30 19:48:34 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:34 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f73d0062-9e6e-4906-a648-60fc3ff38e8a" returned: 0 in 0.295s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Lock "cinder-quobyte-f73d0062-9e6e-4906-a648-60fc3ff38e8a" released by "delete_volume" :: held 0.771s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (440115a8-45dd-46e3-9ab1-142594f0b676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4397f13b-6756-4d89-8e4b-ebff78a74f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4397f13b-6756-4d89-8e4b-ebff78a74f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364515687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee84c4f-7b35-49f8-bf9c-d93f5a3c283e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:35Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc7e525-9e60-4c48-9a2f-982bcb855fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc7e525-9e60-4c48-9a2f-982bcb855fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cce6c50-0dae-48b3-8c1e-802d9638fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cce6c50-0dae-48b3-8c1e-802d9638fb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee84c4f-7b35-49f8-bf9c-d93f5a3c283e', 'volume_name': 'volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850d67eb-f022-4ff9-ab8e-761d8d49dc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850d67eb-f022-4ff9-ab8e-761d8d49dc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5600b9e5-63ef-45bf-80f1-c169e7356c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:34 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume bee84c4f-7b35-49f8-bf9c-d93f5a3c283e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e', 'volume_size': 1} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364515687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee84c4f-7b35-49f8-bf9c-d93f5a3c283e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:35Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Creating volume bee84c4f-7b35-49f8-bf9c-d93f5a3c283e {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:34 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:35 devstack cinder-volume[87426]: WARNING cinder.quota [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-510362008 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-510362008, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:48:35 devstack cinder-volume[87426]: WARNING cinder.quota [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-510362008 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-510362008, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:48:35 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e 1073741824 Sep 30 19:48:35 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Created reservations ['bacfff90-01af-415d-8499-e49e4ef29992', '3b6a0924-737f-488c-be6b-edaec2bbd984', '3076e35b-30f9-427e-b4c4-7a6f7fdd8496', '0eada107-debf-497e-9abb-f5c47b9301b8'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:35 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:35 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:35 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.314s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:35 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Deleted volume successfully. Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-42346f15-7850-40e5-be70-908efb665b07 tempest-VolumeTypesAccessTest-418702714 None] Lock "cinder-f73d0062-9e6e-4906-a648-60fc3ff38e8a-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:35 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e 1073741824" returned: 0 in 0.561s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:35 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e Sep 30 19:48:35 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:35 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e" returned: 0 in 0.299s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5600b9e5-63ef-45bf-80f1-c169e7356c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da34918c-82a0-4ca4-80a0-93c5eef96654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:35 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e (bee84c4f-7b35-49f8-bf9c-d93f5a3c283e): created successfully Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da34918c-82a0-4ca4-80a0-93c5eef96654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (440115a8-45dd-46e3-9ab1-142594f0b676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:35 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f28e4fe0-3518-41c7-b9a2-d235d883ae6e tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created volume successfully. Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (e3889a3c-631b-4d9e-9e50-6df502b9addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a19458-d364-4e3f-b4a8-1b540dcbf3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a19458-d364-4e3f-b4a8-1b540dcbf3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-592544898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:38Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f28f934-3ad9-4f71-b9ca-6805029f9ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f28f934-3ad9-4f71-b9ca-6805029f9ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6dfa49-da37-4050-a6f7-348d82c32428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6dfa49-da37-4050-a6f7-348d82c32428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6', 'volume_name': 'volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f987549-0438-4dc4-b093-41ffb3e8b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f987549-0438-4dc4-b093-41ffb3e8b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cf1764-2ad8-4891-891a-432791ab9ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:37 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume 2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6', 'volume_size': 1} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-592544898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:38Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Creating volume 2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:37 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:37 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 1073741824 Sep 30 19:48:37 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (1e2426a4-247d-4e1a-9401-28d1faeaf459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb05dc3-2ed8-49f0-9b42-4e74b726274b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb05dc3-2ed8-49f0-9b42-4e74b726274b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188740958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc9ef99-8018-473d-b4c7-432a9755f049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:38Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f856349-86e3-4483-a4fc-d70cff4fd889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f856349-86e3-4483-a4fc-d70cff4fd889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836f2e8c-1096-471b-a348-4e49fed41a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836f2e8c-1096-471b-a348-4e49fed41a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cc9ef99-8018-473d-b4c7-432a9755f049', 'volume_name': 'volume-5cc9ef99-8018-473d-b4c7-432a9755f049', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94a4e57-9891-4533-a0d6-6122e18587ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94a4e57-9891-4533-a0d6-6122e18587ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3340c99a-cac1-4d90-b914-eb4e4abb1532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume 5cc9ef99-8018-473d-b4c7-432a9755f049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cc9ef99-8018-473d-b4c7-432a9755f049', 'volume_size': 1} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:38 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (31b6aae7-7ba3-4d97-a875-730e193c248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5362ba-ac10-48e0-a943-195a3816ba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 1073741824" returned: 0 in 0.987s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5362ba-ac10-48e0-a943-195a3816ba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520294504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4de7367-d5bb-4940-9f2a-b4ebfa226c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:39Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f875c1-d9c7-44b7-a673-f67a432126ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f875c1-d9c7-44b7-a673-f67a432126ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89fc49f-73fa-439b-b854-206830118226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89fc49f-73fa-439b-b854-206830118226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4de7367-d5bb-4940-9f2a-b4ebfa226c56', 'volume_name': 'volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7603b5-f073-401d-94de-142f438b2a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7603b5-f073-401d-94de-142f438b2a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbf2741-d18b-4714-93be-0854a70ea3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:38 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume c4de7367-d5bb-4940-9f2a-b4ebfa226c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56', 'volume_size': 1} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:38 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 Sep 30 19:48:38 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (fae0cfc0-6119-458b-923c-5b54f8cce1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73530645-4052-4d55-a1a4-5bd53b05a7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73530645-4052-4d55-a1a4-5bd53b05a7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356349643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a87192f-06e3-48c4-8fa1-a9e1aa35445f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:39Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57aa4fd-4857-43d6-9e0f-add6962f00c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57aa4fd-4857-43d6-9e0f-add6962f00c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455c2969-7013-4532-ae00-f67654be9ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455c2969-7013-4532-ae00-f67654be9ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a87192f-06e3-48c4-8fa1-a9e1aa35445f', 'volume_name': 'volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935ac2b1-ad21-4e2d-b596-8978239e7d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935ac2b1-ad21-4e2d-b596-8978239e7d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257e68dd-ffcf-42bb-8c97-ea43bb8db68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume 9a87192f-06e3-48c4-8fa1-a9e1aa35445f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f', 'volume_size': 1} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:39 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6" returned: 0 in 0.516s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.249s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188740958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc9ef99-8018-473d-b4c7-432a9755f049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:38Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Creating volume 5cc9ef99-8018-473d-b4c7-432a9755f049 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:39 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cf1764-2ad8-4891-891a-432791ab9ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049 1073741824 Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130414df-6f71-45a9-845e-68dc026f9820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:39 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 (2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6): created successfully Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130414df-6f71-45a9-845e-68dc026f9820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (e3889a3c-631b-4d9e-9e50-6df502b9addc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3e6b0b26-3bc5-409a-a45f-f35fd32c61d3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created volume successfully. Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (ff652d8e-7b75-45d0-96cb-164ec7eab9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b096ae5-a3ad-4dff-a5f7-84b6abb40905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b096ae5-a3ad-4dff-a5f7-84b6abb40905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-195236788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733c0bc4-bfb8-496b-ac16-40a721003080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:40Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af4243c-dd8e-475a-85a0-001654051181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af4243c-dd8e-475a-85a0-001654051181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd1e4df-c1f5-437e-9838-20145f6ff211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd1e4df-c1f5-437e-9838-20145f6ff211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733c0bc4-bfb8-496b-ac16-40a721003080', 'volume_name': 'volume-733c0bc4-bfb8-496b-ac16-40a721003080', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72069a49-b2e2-407a-8773-1693810763ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72069a49-b2e2-407a-8773-1693810763ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dbb447-7a46-4d4e-869b-bbfefb0d0585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:39 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume 733c0bc4-bfb8-496b-ac16-40a721003080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733c0bc4-bfb8-496b-ac16-40a721003080', 'volume_size': 1} Sep 30 19:48:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:40 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049 1073741824" returned: 0 in 0.625s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:40 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049 Sep 30 19:48:40 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:40 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049" returned: 0 in 0.266s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520294504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4de7367-d5bb-4940-9f2a-b4ebfa226c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:39Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Creating volume c4de7367-d5bb-4940-9f2a-b4ebfa226c56 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:40 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3340c99a-cac1-4d90-b914-eb4e4abb1532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc9ef99-8018-473d-b4c7-432a9755f049', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:40 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 1073741824 Sep 30 19:48:40 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd17d87b-037b-4d3e-bff5-774073bff3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:40 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume volume-5cc9ef99-8018-473d-b4c7-432a9755f049 (5cc9ef99-8018-473d-b4c7-432a9755f049): created successfully Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd17d87b-037b-4d3e-bff5-774073bff3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (1e2426a4-247d-4e1a-9401-28d1faeaf459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:40 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-98f58a78-401b-43b6-b6b2-4d819d7ab8d6 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created volume successfully. Sep 30 19:48:41 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 1073741824" returned: 0 in 0.651s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:41 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 Sep 30 19:48:41 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:41 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56" returned: 0 in 0.356s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.055s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356349643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a87192f-06e3-48c4-8fa1-a9e1aa35445f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:39Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Creating volume 9a87192f-06e3-48c4-8fa1-a9e1aa35445f {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:41 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbf2741-d18b-4714-93be-0854a70ea3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6418b5c6-e097-4399-8ead-4218460c4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:41 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f 1073741824 Sep 30 19:48:41 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:41 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 (c4de7367-d5bb-4940-9f2a-b4ebfa226c56): created successfully Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6418b5c6-e097-4399-8ead-4218460c4a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (31b6aae7-7ba3-4d97-a875-730e193c248e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:41 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ff6fa8fe-67fc-4148-a3d9-0a826afb12ff tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created volume successfully. Sep 30 19:48:42 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f 1073741824" returned: 0 in 0.763s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:42 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f Sep 30 19:48:42 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:42 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.827s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-195236788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733c0bc4-bfb8-496b-ac16-40a721003080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd37e79747e4eeebb7d98d41f627c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:40Z,use_quota=True,user_id='d7a401fe4db44e82b6ef2b66d9f61810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Creating volume 733c0bc4-bfb8-496b-ac16-40a721003080 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:42 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:42 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080 1073741824 Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257e68dd-ffcf-42bb-8c97-ea43bb8db68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:42 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e998be-327e-4961-b90b-f9a46e2791c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:42 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f (9a87192f-06e3-48c4-8fa1-a9e1aa35445f): created successfully Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e998be-327e-4961-b90b-f9a46e2791c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (fae0cfc0-6119-458b-923c-5b54f8cce1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a8b0b8cc-dfc4-46a9-8ab2-7f4fb6eaafd3 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created volume successfully. Sep 30 19:48:43 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080 1073741824" returned: 0 in 0.701s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:43 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080 Sep 30 19:48:43 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:43 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080" returned: 0 in 0.266s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dbb447-7a46-4d4e-869b-bbfefb0d0585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733c0bc4-bfb8-496b-ac16-40a721003080', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf00c80-49b4-492d-a749-48e679ddeb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:43 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Volume volume-733c0bc4-bfb8-496b-ac16-40a721003080 (733c0bc4-bfb8-496b-ac16-40a721003080): created successfully Sep 30 19:48:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf00c80-49b4-492d-a749-48e679ddeb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Flow 'volume_create_manager' (ff652d8e-7b75-45d0-96cb-164ec7eab9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:43 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-43c3ce5b-65ee-4551-836b-0e312dd0d93c tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created volume successfully. Sep 30 19:48:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-733c0bc4-bfb8-496b-ac16-40a721003080-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-733c0bc4-bfb8-496b-ac16-40a721003080-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-quobyte-733c0bc4-bfb8-496b-ac16-40a721003080" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-733c0bc4-bfb8-496b-ac16-40a721003080" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:44 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[89df8fda-4a19-420b-9b8e-588a30c68751]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:44 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080 Sep 30 19:48:44 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:44 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080" returned: 0 in 0.445s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:44 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080 Sep 30 19:48:44 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:45 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-733c0bc4-bfb8-496b-ac16-40a721003080" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-733c0bc4-bfb8-496b-ac16-40a721003080" released by "delete_volume" :: held 0.782s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created reservations ['e1911e8a-fdd3-4ed6-88a3-ec577ac82b67', 'ce4fdfb9-3e63-4319-aa5e-6a4b75b698b2', 'cbdfae72-2b9a-4f49-a468-b5b5decaa29d', 'c9d84fcb-90d4-46f1-ada9-b9fac015e43a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:45 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:45 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-9a87192f-06e3-48c4-8fa1-a9e1aa35445f-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-9a87192f-06e3-48c4-8fa1-a9e1aa35445f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-quobyte-9a87192f-06e3-48c4-8fa1-a9e1aa35445f" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-9a87192f-06e3-48c4-8fa1-a9e1aa35445f" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb464e25-026d-4eba-a03a-ea1abc188bd8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:45 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.372s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Deleted volume successfully. Sep 30 19:48:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2b570917-e779-4dd5-80cd-0b062a321f00 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-733c0bc4-bfb8-496b-ac16-40a721003080-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:45 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f Sep 30 19:48:45 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:46 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f" returned: 0 in 0.541s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:46 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f Sep 30 19:48:46 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:46 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-9a87192f-06e3-48c4-8fa1-a9e1aa35445f" returned: 0 in 0.264s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-9a87192f-06e3-48c4-8fa1-a9e1aa35445f" released by "delete_volume" :: held 0.868s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created reservations ['7dae29b7-2f05-42ec-861d-9309a971587c', '906041f0-5c56-4ef7-a178-e5fdb2fb280c', '9888ee61-edfe-4ca8-925d-f22937cc3ad7', '1dedca05-1932-47f7-bbdb-1ef625836505'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:46 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:46 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-c4de7367-d5bb-4940-9f2a-b4ebfa226c56-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-c4de7367-d5bb-4940-9f2a-b4ebfa226c56-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-quobyte-c4de7367-d5bb-4940-9f2a-b4ebfa226c56" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-c4de7367-d5bb-4940-9f2a-b4ebfa226c56" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[830f8491-557a-4db6-af5d-2dfbfd2eeef3]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:47 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.299s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:47 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:47 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Deleted volume successfully. Sep 30 19:48:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fb35e5cb-9a00-4e62-a851-9253f02db199 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-9a87192f-06e3-48c4-8fa1-a9e1aa35445f-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:47 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 Sep 30 19:48:47 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:47 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56" returned: 0 in 0.411s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:47 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56 Sep 30 19:48:47 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:47 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c4de7367-d5bb-4940-9f2a-b4ebfa226c56" returned: 0 in 0.450s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-c4de7367-d5bb-4940-9f2a-b4ebfa226c56" released by "delete_volume" :: held 0.920s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:47 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created reservations ['b699d8b6-5d26-4d36-b35b-1383e0755e52', '9d548112-8ac0-4efb-8456-a543835f2762', '8951c4f8-1e8f-4cc5-9320-508cfdf06c06', '336cc6d0-c962-4183-be5e-28fa2e91be67'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:48 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:48 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:48 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:48 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Deleted volume successfully. Sep 30 19:48:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dfc9ff5d-2ed4-4c57-8b2b-9720691cdaaa tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-c4de7367-d5bb-4940-9f2a-b4ebfa226c56-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-5cc9ef99-8018-473d-b4c7-432a9755f049-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-5cc9ef99-8018-473d-b4c7-432a9755f049-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-quobyte-5cc9ef99-8018-473d-b4c7-432a9755f049" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-5cc9ef99-8018-473d-b4c7-432a9755f049" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae4a169-1da3-4793-b218-fa60fd7dc9ea]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:49 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049 Sep 30 19:48:49 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Flow 'volume_create_manager' (2d1063d9-9d1f-4f4b-a587-29d4386eec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1008635b-6864-4d5a-b927-1f8f3abe939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1008635b-6864-4d5a-b927-1f8f3abe939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-347122858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f45d292-37e7-4165-825c-1477d854d4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa360474250f42708b63f06fefa1ebc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:50Z,use_quota=True,user_id='0669a056ff4e4b4aaccac1fb52123442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d77c06e-e11a-430c-a4f5-677bed2e917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:49 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d77c06e-e11a-430c-a4f5-677bed2e917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01286270-26c3-4c67-b73d-e3d802aa9c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01286270-26c3-4c67-b73d-e3d802aa9c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f45d292-37e7-4165-825c-1477d854d4da', 'volume_name': 'volume-7f45d292-37e7-4165-825c-1477d854d4da', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9ced7d-590f-4f97-8a6d-9ebd36f04ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9ced7d-590f-4f97-8a6d-9ebd36f04ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d5fe49-d256-4ae6-9b2f-561ed44835fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:49 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Volume 7f45d292-37e7-4165-825c-1477d854d4da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f45d292-37e7-4165-825c-1477d854d4da', 'volume_size': 1} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-347122858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f45d292-37e7-4165-825c-1477d854d4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa360474250f42708b63f06fefa1ebc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:50Z,use_quota=True,user_id='0669a056ff4e4b4aaccac1fb52123442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Creating volume 7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:49 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049" returned: 0 in 0.531s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:49 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da 1073741824 Sep 30 19:48:49 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:49 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049 Sep 30 19:48:49 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:50 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-5cc9ef99-8018-473d-b4c7-432a9755f049" returned: 0 in 0.328s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-5cc9ef99-8018-473d-b4c7-432a9755f049" released by "delete_volume" :: held 0.934s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created reservations ['872a0cfc-f6e8-4a1e-b0db-0fd14aaef858', '120ad8a2-bc3f-4814-967f-2675687d55ac', '21a3555e-d131-465a-839e-cc50cf60bf25', '165a98e1-aa76-4db7-9664-097cd394d9dc'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:50 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da 1073741824" returned: 0 in 0.564s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:50 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:50 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:50 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da Sep 30 19:48:50 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-quobyte-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac6932e-bbb8-48c3-af28-e4e083890b74]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:50 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 Sep 30 19:48:50 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:50 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.431s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:50 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Deleted volume successfully. Sep 30 19:48:50 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da" returned: 0 in 0.432s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-09fca7c1-da01-4feb-96f2-9f69af07a446 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-5cc9ef99-8018-473d-b4c7-432a9755f049-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d5fe49-d256-4ae6-9b2f-561ed44835fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f45d292-37e7-4165-825c-1477d854d4da', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003cc50a-b605-4b33-b768-969641c11b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:50 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Volume volume-7f45d292-37e7-4165-825c-1477d854d4da (7f45d292-37e7-4165-825c-1477d854d4da): created successfully Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003cc50a-b605-4b33-b768-969641c11b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Flow 'volume_create_manager' (2d1063d9-9d1f-4f4b-a587-29d4386eec83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:50 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-66beebeb-2a92-480a-9844-b05a95e5ad10 tempest-VolumesDeleteCascade-160354790 None] Created volume successfully. Sep 30 19:48:51 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6" returned: 0 in 0.555s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:51 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6 Sep 30 19:48:51 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:51 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6" returned: 0 in 0.306s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6" released by "delete_volume" :: held 0.967s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created reservations ['0b0c280b-0c57-427d-bb46-c21907a321a7', 'c90f42c0-6874-41d5-81c6-72fc66530762', '4cc26ef2-b491-458f-9447-d058c02a8de9', '5f6c0072-ba60-4c26-b08b-d0b2fb1aa6ac'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:51 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:51 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "cinder-quobyte-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b26887d-5fa3-4512-be4f-2ac465daec47]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:52 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e Sep 30 19:48:52 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:52 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.449s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Deleted volume successfully. Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b7d8ebf7-7f6b-4d04-9df1-cd8ec5fa9514 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-2d5c34d7-89ec-45ea-b2e9-5ae83e12b8c6-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Creating offline snapshot 0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 of volume 7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[407f6322-e63e-4da0-aa29-1eae3bceddd3]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:52 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e" returned: 0 in 0.434s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:52 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da Sep 30 19:48:52 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:52 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e Sep 30 19:48:52 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:52 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e" returned: 0 in 0.258s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-quobyte-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e" released by "delete_volume" :: held 0.772s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:52 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da" returned: 0 in 0.418s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:52 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 1G Sep 30 19:48:52 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Created reservations ['f1dfd964-67ab-417f-9f4a-0b9f463eeb7f', '55ece4b2-87ca-4b31-b732-06133e50785f', '3764065f-c55b-4adc-b172-b101f5fd856d', '8f7155d6-f09d-48c4-8e8b-7cf116450808'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:52 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:48:52 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:53 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.303s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:53 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:48:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Deleted volume successfully. Sep 30 19:48:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a41c4061-1f63-4fc4-ab17-e9a152860bb9 tempest-CreateVolumesFromSourceVolumeTest-1695119599 None] Lock "cinder-bee84c4f-7b35-49f8-bf9c-d93f5a3c283e-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:48:53 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 1G" returned: 0 in 0.537s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45d292-37e7-4165-825c-1477d854d4da -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:53 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45d292-37e7-4165-825c-1477d854d4da -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 Sep 30 19:48:53 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:53 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45d292-37e7-4165-825c-1477d854d4da -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" returned: 0 in 0.323s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:53 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 is being set with open permissions: ugo+rw Sep 30 19:48:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:53 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 Sep 30 19:48:53 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:53 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" returned: 0 in 0.310s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:53 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.info Sep 30 19:48:53 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:54 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.info" returned: 0 in 0.296s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:54 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.info is being set with open permissions: ugo+rw Sep 30 19:48:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:54 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.info Sep 30 19:48:54 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:54 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.info" returned: 0 in 0.316s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:54 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f419647d-9e73-4a89-9faa-771b7c2c6c3b tempest-VolumesDeleteCascade-160354790 None] Create snapshot completed successfully Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Flow 'volume_create_manager' (3ed8f40d-6f44-467a-a32f-b7f89faa8033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8036f8-fa9f-4b66-87b2-5b9983b70a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8036f8-fa9f-4b66-87b2-5b9983b70a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1856378776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8d1ad6-3804-40eb-872f-6f3f541e8348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435c3452abe44fce9735003562317a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:55Z,use_quota=True,user_id='0e9755b7ff8b4b93a461be5c1b323f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e05ee9b-8dfb-4193-990e-4e55685e1766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e05ee9b-8dfb-4193-990e-4e55685e1766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276e8a85-2140-40b4-9e30-589af1ed7b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276e8a85-2140-40b4-9e30-589af1ed7b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8d1ad6-3804-40eb-872f-6f3f541e8348', 'volume_name': 'volume-df8d1ad6-3804-40eb-872f-6f3f541e8348', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8019d7-558b-4c6f-8c94-391183ee55f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8019d7-558b-4c6f-8c94-391183ee55f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0799b3-5aab-479a-88a7-8076f1e63a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:55 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Volume df8d1ad6-3804-40eb-872f-6f3f541e8348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8d1ad6-3804-40eb-872f-6f3f541e8348', 'volume_size': 1} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1856378776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8d1ad6-3804-40eb-872f-6f3f541e8348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435c3452abe44fce9735003562317a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:48:55Z,use_quota=True,user_id='0e9755b7ff8b4b93a461be5c1b323f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Creating volume df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:48:55 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:55 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 1073741824 Sep 30 19:48:55 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:48:55 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 1073741824" returned: 0 in 0.521s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:56 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 Sep 30 19:48:56 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:56 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348" returned: 0 in 0.307s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.746s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0799b3-5aab-479a-88a7-8076f1e63a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8d1ad6-3804-40eb-872f-6f3f541e8348', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b00775-26c6-4fc2-906b-505824f35b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Creating offline snapshot e792256f-7224-4b9c-80c0-ae34b2d338aa of volume 7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:48:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Volume volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 (df8d1ad6-3804-40eb-872f-6f3f541e8348): created successfully Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b00775-26c6-4fc2-906b-505824f35b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Flow 'volume_create_manager' (3ed8f40d-6f44-467a-a32f-b7f89faa8033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee8746a-2772-45a3-82d0-6ee4b6405658]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3eda4aba-bafb-48aa-8a18-981003477d94 tempest-TestStampPattern-2098654366 None] Created volume successfully. Sep 30 19:48:56 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 Sep 30 19:48:56 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:56 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" returned: 0 in 0.462s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f45d292-37e7-4165-825c-1477d854d4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:48:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:56 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa 1G Sep 30 19:48:56 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:57 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa 1G" returned: 0 in 0.595s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:57 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa Sep 30 19:48:57 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:57 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa" returned: 0 in 0.378s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:57 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa is being set with open permissions: ugo+rw Sep 30 19:48:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:57 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa Sep 30 19:48:57 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:58 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa" returned: 0 in 0.311s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:48:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f3821636-3fbc-43dc-b1cc-4da1fe34e422 tempest-VolumesDeleteCascade-160354790 None] Create snapshot completed successfully Sep 30 19:48:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-7f45d292-37e7-4165-825c-1477d854d4da-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-7f45d292-37e7-4165-825c-1477d854d4da-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Performing cascade delete. {{(pid=87426) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 30 19:48:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-7f45d292-37e7-4165-825c-1477d854d4da" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-7f45d292-37e7-4165-825c-1477d854d4da" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Deleting offline snapshot 0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 of volume 7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] snapshot_file for this snap is: volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a52178-24f1-4814-8a87-7b25738646f7]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:59 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 Sep 30 19:48:59 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:48:59 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" returned: 0 in 0.435s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f45d292-37e7-4165-825c-1477d854d4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d9af1b-676c-4b66-a950-08dc7e0f79d9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:48:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:48:59 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da Sep 30 19:48:59 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:00 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da" returned: 0 in 0.488s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:00 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[baded052-741f-454d-bdfb-0efd55aabda3]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:00 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa Sep 30 19:49:00 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:00 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa" returned: 0 in 0.421s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f45d292-37e7-4165-825c-1477d854d4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:49:00 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fead944-f11c-49c0-a4e9-d0302ae68a39]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:00 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 Sep 30 19:49:00 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:01 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" returned: 0 in 0.421s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f45d292-37e7-4165-825c-1477d854d4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:49:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e736b8ea-f0a5-4403-a14c-24bb41095da4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:01 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da Sep 30 19:49:01 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:01 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da" returned: 0 in 0.633s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:01 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 Sep 30 19:49:01 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:02 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" returned: 0 in 0.693s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:02 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32 Sep 30 19:49:02 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:02 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" returned: 0 in 0.412s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45d292-37e7-4165-825c-1477d854d4da /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa -F qcow2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:02 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45d292-37e7-4165-825c-1477d854d4da /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa -F qcow2 Sep 30 19:49:02 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:03 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f45d292-37e7-4165-825c-1477d854d4da /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa -F qcow2" returned: 0 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32" released by "_delete_snapshot" :: held 4.111s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-7f45d292-37e7-4165-825c-1477d854d4da" released by "delete_snapshot" :: held 4.144s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Created reservations ['6e369c2e-8599-43af-80af-db47eebc3277', 'efb5ad63-3d4a-4c48-943a-84818daaf7d3', '57ce7b54-b1a7-4552-b5d8-0f947980bb42', 'f41232bf-7526-4d75-82be-cbccf9439b58'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Delete snapshot completed successfully. Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-0a291fdb-6a2f-4de8-8e3b-1d8e23ceab32-delete_snapshot" released by "delete_snapshot" :: held 4.357s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-e792256f-7224-4b9c-80c0-ae34b2d338aa-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-e792256f-7224-4b9c-80c0-ae34b2d338aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-7f45d292-37e7-4165-825c-1477d854d4da" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-7f45d292-37e7-4165-825c-1477d854d4da" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-e792256f-7224-4b9c-80c0-ae34b2d338aa" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-e792256f-7224-4b9c-80c0-ae34b2d338aa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Deleting offline snapshot e792256f-7224-4b9c-80c0-ae34b2d338aa of volume 7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] snapshot_file for this snap is: volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6983108b-d7cf-4aa0-ae82-4c1bb01fbe65]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:03 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa Sep 30 19:49:03 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:03 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa" returned: 0 in 0.450s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f45d292-37e7-4165-825c-1477d854d4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:49:04 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8d83a6-51e3-476e-90d7-42a23a2a04db]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:04 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da Sep 30 19:49:04 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:04 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da" returned: 0 in 0.587s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:04 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa Sep 30 19:49:04 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:05 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa" returned: 0 in 0.516s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:05 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa Sep 30 19:49:05 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:05 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da.e792256f-7224-4b9c-80c0-ae34b2d338aa" returned: 0 in 0.398s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-e792256f-7224-4b9c-80c0-ae34b2d338aa" released by "_delete_snapshot" :: held 2.123s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-7f45d292-37e7-4165-825c-1477d854d4da" released by "delete_snapshot" :: held 2.159s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Created reservations ['19a3092d-f2d7-40d1-bd0e-dbfbca3c3d8c', 'e19dedd1-d3a8-4014-a22f-58f70ea63866', '01ae7a6b-ccdb-4324-81dc-d418a687b2e3', '27841da8-b16c-43d3-bbf0-a5f35da99e6f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:05 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Delete snapshot completed successfully. Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-e792256f-7224-4b9c-80c0-ae34b2d338aa-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Snapshots deleted, issuing volume delete {{(pid=87426) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-7f45d292-37e7-4165-825c-1477d854d4da" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-7f45d292-37e7-4165-825c-1477d854d4da" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3241a311-3752-4dbb-8be1-0e8097931175]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:06 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da Sep 30 19:49:06 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:06 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da" returned: 0 in 0.522s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:06 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da Sep 30 19:49:06 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:06 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f45d292-37e7-4165-825c-1477d854d4da" returned: 0 in 0.443s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-7f45d292-37e7-4165-825c-1477d854d4da" released by "delete_volume" :: held 1.086s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:06 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Created reservations ['caeed711-8de2-47a1-93a8-776c2290a7dc', '90f87896-f27a-472c-a739-4e1aa74c91e1', '1e5357b8-b003-4050-b305-9957051af0e0', '67178d52-ab1f-4807-a9fc-6b1be328fc91'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:07 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:49:07 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:07 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.356s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:07 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:49:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Deleted volume successfully. Sep 30 19:49:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-89138c76-fd8b-44d8-8a71-471ae5216ae7 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-7f45d292-37e7-4165-825c-1477d854d4da-delete_volume" released by "delete_volume" :: held 8.573s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:08 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:49:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Flow 'volume_create_manager' (4604d16a-097e-4c08-963f-e1237fc856cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98c44a2-9292-4950-abfd-ab869234c7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98c44a2-9292-4950-abfd-ab869234c7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-444750813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39f9ed3-544e-436c-a529-b8a7e83a4e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa360474250f42708b63f06fefa1ebc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:09Z,use_quota=True,user_id='0669a056ff4e4b4aaccac1fb52123442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febadddd-07bc-49f4-8268-c927cd4d4f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febadddd-07bc-49f4-8268-c927cd4d4f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c127e62-833e-4940-b3e0-2e3ee3d54415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c127e62-833e-4940-b3e0-2e3ee3d54415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39f9ed3-544e-436c-a529-b8a7e83a4e8d', 'volume_name': 'volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cc355a-02e8-44d9-b297-cda2abcd4682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cc355a-02e8-44d9-b297-cda2abcd4682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c6652c-3861-4bcd-89cd-f80a27fc161a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Volume a39f9ed3-544e-436c-a529-b8a7e83a4e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d', 'volume_size': 1} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-444750813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39f9ed3-544e-436c-a529-b8a7e83a4e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa360474250f42708b63f06fefa1ebc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:09Z,use_quota=True,user_id='0669a056ff4e4b4aaccac1fb52123442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Creating volume a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:49:09 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:09 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d 1073741824 Sep 30 19:49:09 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Flow 'volume_create_manager' (726c2470-0f52-45ee-89f7-bf67bc314f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a8b465-5824-4ea2-a1cb-e389de7470fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a8b465-5824-4ea2-a1cb-e389de7470fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1893171468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de23111d-4df7-4bce-ade8-5b166ad6d36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca560dff78e4d7b80f19d7f822ff62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:09Z,use_quota=True,user_id='72bc9f7e987849ec8aa1a97f31969bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5131908b-541c-4caa-9c47-2cff36a64a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5131908b-541c-4caa-9c47-2cff36a64a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1edb2787-fbd9-4ee5-b8c3-947d2b86c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1edb2787-fbd9-4ee5-b8c3-947d2b86c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de23111d-4df7-4bce-ade8-5b166ad6d36b', 'volume_name': 'volume-de23111d-4df7-4bce-ade8-5b166ad6d36b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b26a8e-ef0b-4a7b-8754-49d518ac3f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b26a8e-ef0b-4a7b-8754-49d518ac3f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf435ddc-5ec5-4f81-af4b-0b89067e0a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Volume de23111d-4df7-4bce-ade8-5b166ad6d36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de23111d-4df7-4bce-ade8-5b166ad6d36b', 'volume_size': 1} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d 1073741824" returned: 0 in 0.550s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:09 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d Sep 30 19:49:09 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:09 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" returned: 0 in 0.266s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1893171468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de23111d-4df7-4bce-ade8-5b166ad6d36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca560dff78e4d7b80f19d7f822ff62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:09Z,use_quota=True,user_id='72bc9f7e987849ec8aa1a97f31969bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Creating volume de23111d-4df7-4bce-ade8-5b166ad6d36b {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:49:09 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c6652c-3861-4bcd-89cd-f80a27fc161a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e828c18-5be8-42c8-bd64-54f7df048937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:09 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b 1073741824 Sep 30 19:49:09 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:09 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Volume volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d (a39f9ed3-544e-436c-a529-b8a7e83a4e8d): created successfully Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e828c18-5be8-42c8-bd64-54f7df048937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Flow 'volume_create_manager' (4604d16a-097e-4c08-963f-e1237fc856cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c9c569e6-fa9e-4206-a40b-94e190d28062 tempest-VolumesDeleteCascade-160354790 None] Created volume successfully. Sep 30 19:49:10 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b 1073741824" returned: 0 in 0.435s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:10 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b Sep 30 19:49:10 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:10 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b" returned: 0 in 0.245s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:10 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:49:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:10 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf435ddc-5ec5-4f81-af4b-0b89067e0a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de23111d-4df7-4bce-ade8-5b166ad6d36b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:10 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc04f51-9382-486b-95e7-ea8c286efaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:10 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Volume volume-de23111d-4df7-4bce-ade8-5b166ad6d36b (de23111d-4df7-4bce-ade8-5b166ad6d36b): created successfully Sep 30 19:49:10 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc04f51-9382-486b-95e7-ea8c286efaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:10 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Flow 'volume_create_manager' (726c2470-0f52-45ee-89f7-bf67bc314f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:10 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f733c9b0-24aa-4a1d-818d-efec927e1217 tempest-ProjectReaderTests-478577947 None] Created volume successfully. Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Creating offline snapshot fbee613c-3d33-46ce-b777-2830abdbd60f of volume a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[982f1a52-94cb-41b4-8089-746948367b85]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:11 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d Sep 30 19:49:11 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:11 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" returned: 0 in 0.379s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:11 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f 1G Sep 30 19:49:11 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Acquiring lock "cinder-de23111d-4df7-4bce-ade8-5b166ad6d36b-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Lock "cinder-de23111d-4df7-4bce-ade8-5b166ad6d36b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Acquiring lock "cinder-quobyte-de23111d-4df7-4bce-ade8-5b166ad6d36b" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Lock "cinder-quobyte-de23111d-4df7-4bce-ade8-5b166ad6d36b" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3e5f88-fc94-476a-a3c6-9b4d5209555c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:12 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:12 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b Sep 30 19:49:12 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f 1G" returned: 0 in 0.497s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:12 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f Sep 30 19:49:12 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:12 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b" returned: 0 in 0.416s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:12 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b Sep 30 19:49:12 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:12 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f" returned: 0 in 0.339s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:12 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f is being set with open permissions: ugo+rw Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:12 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f Sep 30 19:49:12 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:12 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-de23111d-4df7-4bce-ade8-5b166ad6d36b" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Lock "cinder-quobyte-de23111d-4df7-4bce-ade8-5b166ad6d36b" released by "delete_volume" :: held 0.720s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:12 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f" returned: 0 in 0.255s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Created reservations ['d2381012-5a30-4d74-8caa-991d49739355', '19fd6855-19e7-40f8-a6c2-a618014778d2', '0a062160-a56d-4a7f-8bcb-a329c0717447', '730371f8-42ce-4dc5-965e-458952b845df'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:12 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.info Sep 30 19:49:12 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:12 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:49:12 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:13 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:13 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.info" returned: 0 in 0.345s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:13 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.info is being set with open permissions: ugo+rw Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.269s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:49:13 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Deleted volume successfully. Sep 30 19:49:13 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.info Sep 30 19:49:13 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9aa0f5bc-3e37-454c-9430-a89257c419c2 tempest-ProjectReaderTests-478577947 None] Lock "cinder-de23111d-4df7-4bce-ade8-5b166ad6d36b-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:13 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.info" returned: 0 in 0.319s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:13 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3c5d62df-6044-4751-840d-87a0a2c1ec2b tempest-VolumesDeleteCascade-160354790 None] Create snapshot completed successfully Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Flow 'volume_create_manager' (dc9fdddc-801b-4221-906b-b5c2213e0e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792925e6-e533-4a9b-bff4-0692522cae87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792925e6-e533-4a9b-bff4-0692522cae87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114574087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a9acbc-fc76-4c12-801d-e2c316b193c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca560dff78e4d7b80f19d7f822ff62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:13Z,use_quota=True,user_id='72bc9f7e987849ec8aa1a97f31969bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d118ab-5784-44d3-8781-30d066b1cb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d118ab-5784-44d3-8781-30d066b1cb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fe7cfb-299e-4255-9967-b27b71d45fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fe7cfb-299e-4255-9967-b27b71d45fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a9acbc-fc76-4c12-801d-e2c316b193c5', 'volume_name': 'volume-07a9acbc-fc76-4c12-801d-e2c316b193c5', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08701cec-1418-41a8-b2fb-b9050849a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08701cec-1418-41a8-b2fb-b9050849a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610dd0db-7216-4bd6-97d7-072c38012729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:13 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Volume 07a9acbc-fc76-4c12-801d-e2c316b193c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a9acbc-fc76-4c12-801d-e2c316b193c5', 'volume_size': 1} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114574087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a9acbc-fc76-4c12-801d-e2c316b193c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca560dff78e4d7b80f19d7f822ff62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:13Z,use_quota=True,user_id='72bc9f7e987849ec8aa1a97f31969bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Creating volume 07a9acbc-fc76-4c12-801d-e2c316b193c5 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:49:13 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:49:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:13 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 1073741824 Sep 30 19:49:13 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:14 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 1073741824" returned: 0 in 0.404s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:14 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 Sep 30 19:49:14 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:14 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610dd0db-7216-4bd6-97d7-072c38012729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a9acbc-fc76-4c12-801d-e2c316b193c5', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3c3791-dcb9-4fa4-9b03-60c6457e125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:14 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Volume volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 (07a9acbc-fc76-4c12-801d-e2c316b193c5): created successfully Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3c3791-dcb9-4fa4-9b03-60c6457e125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Flow 'volume_create_manager' (dc9fdddc-801b-4221-906b-b5c2213e0e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:14 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1c66da11-8efa-42d3-8821-9457a353879d tempest-ProjectReaderTests-478577947 None] Created volume successfully. Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Acquiring lock "cinder-07a9acbc-fc76-4c12-801d-e2c316b193c5-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Lock "cinder-07a9acbc-fc76-4c12-801d-e2c316b193c5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Acquiring lock "cinder-quobyte-07a9acbc-fc76-4c12-801d-e2c316b193c5" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Lock "cinder-quobyte-07a9acbc-fc76-4c12-801d-e2c316b193c5" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6402a041-f77b-4457-b3dd-5074b73a6b8e]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:14 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 Sep 30 19:49:14 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:14 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Flow 'volume_create_manager' (d1c0ddc8-c39d-4e08-8cb6-92b2718a9461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865ea179-2c4c-4dc2-ac8d-2272565fd1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865ea179-2c4c-4dc2-ac8d-2272565fd1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1974257601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f045620c-b3f5-441e-980f-2c517c2dbd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa360474250f42708b63f06fefa1ebc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fbee613c-3d33-46ce-b777-2830abdbd60f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:15Z,use_quota=True,user_id='0669a056ff4e4b4aaccac1fb52123442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63ed715-cf22-476b-bedf-e329679afcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63ed715-cf22-476b-bedf-e329679afcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83fcbd4-2b4c-4425-8f97-14ff7fc1aca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83fcbd4-2b4c-4425-8f97-14ff7fc1aca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f045620c-b3f5-441e-980f-2c517c2dbd66', 'volume_name': 'volume-f045620c-b3f5-441e-980f-2c517c2dbd66', 'volume_size': 1, 'snapshot_id': 'fbee613c-3d33-46ce-b777-2830abdbd60f'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a7de54-b0af-458f-b7af-2ee2ad5d0706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a7de54-b0af-458f-b7af-2ee2ad5d0706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28943b57-05a2-453d-af9c-397003374746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:15 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Volume f045620c-b3f5-441e-980f-2c517c2dbd66: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f045620c-b3f5-441e-980f-2c517c2dbd66', 'volume_size': 1, 'snapshot_id': 'fbee613c-3d33-46ce-b777-2830abdbd60f'} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-fbee613c-3d33-46ce-b777-2830abdbd60f-f045620c-b3f5-441e-980f-2c517c2dbd66" by "_create_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-fbee613c-3d33-46ce-b777-2830abdbd60f-f045620c-b3f5-441e-980f-2c517c2dbd66" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Creating volume f045620c-b3f5-441e-980f-2c517c2dbd66 from snapshot fbee613c-3d33-46ce-b777-2830abdbd60f {{(pid=87426) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-f045620c-b3f5-441e-980f-2c517c2dbd66" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-f045620c-b3f5-441e-980f-2c517c2dbd66" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] snapshot: fbee613c-3d33-46ce-b777-2830abdbd60f, volume: f045620c-b3f5-441e-980f-2c517c2dbd66, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[334ecd7e-f54c-4c07-b901-c6b8f064dbaf]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:15 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5" returned: 0 in 0.442s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:15 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5 Sep 30 19:49:15 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:15 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f Sep 30 19:49:15 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:15 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-07a9acbc-fc76-4c12-801d-e2c316b193c5" returned: 0 in 0.266s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Lock "cinder-quobyte-07a9acbc-fc76-4c12-801d-e2c316b193c5" released by "delete_volume" :: held 0.779s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Created reservations ['feeec9ff-9fea-421a-9217-22ee65392545', 'c52c2ce8-d5e9-491c-8cf5-3502eaaf1bb0', '28e9c423-ea7c-4e07-b908-3bdc487ba35e', '835ea804-744c-4062-b1c6-4f1c908c265f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:15 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f" returned: 0 in 0.461s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c2708f-27a4-408a-b656-fb5826cfc399]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:15 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:49:15 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:15 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d Sep 30 19:49:15 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:16 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" returned: 0 in 0.502s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:16 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.496s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:49:16 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 Sep 30 19:49:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Deleted volume successfully. Sep 30 19:49:16 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=153,cinder:UPDATE=218,cinder:INSERT=52,cinder:DELETE=18 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80497e4a-b0be-444d-ab28-927e2afe9258 tempest-ProjectReaderTests-478577947 None] Lock "cinder-07a9acbc-fc76-4c12-801d-e2c316b193c5-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Flow 'volume_create_manager' (b2aabfe5-1070-4a3a-bad3-dcd04f193ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffe39d2-77d6-4902-882a-28cc7ff049c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffe39d2-77d6-4902-882a-28cc7ff049c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409834411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7004a2e6-908e-4a17-a634-e0c00857ab06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca560dff78e4d7b80f19d7f822ff62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:16Z,use_quota=True,user_id='72bc9f7e987849ec8aa1a97f31969bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2406bc-ba32-4ce1-8e50-abe501d6c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2406bc-ba32-4ce1-8e50-abe501d6c26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf47a265-9c4e-40e0-844c-b985cd5d92f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf47a265-9c4e-40e0-844c-b985cd5d92f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7004a2e6-908e-4a17-a634-e0c00857ab06', 'volume_name': 'volume-7004a2e6-908e-4a17-a634-e0c00857ab06', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f6e26-c801-422f-ad78-01ad949b8e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f6e26-c801-422f-ad78-01ad949b8e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b631eecd-8e09-42ca-a9fa-0e35f67148ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:16 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Volume 7004a2e6-908e-4a17-a634-e0c00857ab06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7004a2e6-908e-4a17-a634-e0c00857ab06', 'volume_size': 1} Sep 30 19:49:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:22 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66" returned: 0 in 6.754s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:22 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:49:22 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Converted 1024.00 MB image at 151.60 MB/s Sep 30 19:49:22 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 is being set with open permissions: ugo+rw Sep 30 19:49:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:22 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 Sep 30 19:49:22 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:23 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-f045620c-b3f5-441e-980f-2c517c2dbd66" released by "_copy_volume_from_snapshot" :: held 8.059s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=200,cinder:SELECT=146,cinder:INSERT=46,cinder:DELETE=15 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-fbee613c-3d33-46ce-b777-2830abdbd60f-f045620c-b3f5-441e-980f-2c517c2dbd66" released by "_create_volume_from_snapshot" :: held 8.134s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.157s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.673s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409834411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7004a2e6-908e-4a17-a634-e0c00857ab06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca560dff78e4d7b80f19d7f822ff62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:16Z,use_quota=True,user_id='72bc9f7e987849ec8aa1a97f31969bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Creating volume 7004a2e6-908e-4a17-a634-e0c00857ab06 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:49:23 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:23 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06 1073741824 Sep 30 19:49:23 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28943b57-05a2-453d-af9c-397003374746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f045620c-b3f5-441e-980f-2c517c2dbd66', 'volume_size': 1, 'snapshot_id': 'fbee613c-3d33-46ce-b777-2830abdbd60f'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41f67b2-328c-4ba2-8ba1-ca7077d63e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:23 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Volume volume-f045620c-b3f5-441e-980f-2c517c2dbd66 (f045620c-b3f5-441e-980f-2c517c2dbd66): created successfully Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41f67b2-328c-4ba2-8ba1-ca7077d63e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Flow 'volume_create_manager' (d1c0ddc8-c39d-4e08-8cb6-92b2718a9461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:23 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-9f4b9368-41ab-4f16-b7a6-4ee940459086 tempest-VolumesDeleteCascade-160354790 None] Created volume successfully. Sep 30 19:49:23 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06 1073741824" returned: 0 in 0.470s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-a39f9ed3-544e-436c-a529-b8a7e83a4e8d-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-a39f9ed3-544e-436c-a529-b8a7e83a4e8d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:23 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06 Sep 30 19:49:23 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Performing cascade delete. {{(pid=87426) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-fbee613c-3d33-46ce-b777-2830abdbd60f-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-fbee613c-3d33-46ce-b777-2830abdbd60f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-fbee613c-3d33-46ce-b777-2830abdbd60f" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-fbee613c-3d33-46ce-b777-2830abdbd60f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:23 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:49:23 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Deleting offline snapshot fbee613c-3d33-46ce-b777-2830abdbd60f of volume a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] snapshot_file for this snap is: volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0670edd-8ee9-4e36-870d-c571ff064b9b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:24 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06" returned: 0 in 0.336s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b631eecd-8e09-42ca-a9fa-0e35f67148ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7004a2e6-908e-4a17-a634-e0c00857ab06', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab2e1d-ac72-4074-9726-64cba902466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:24 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Volume volume-7004a2e6-908e-4a17-a634-e0c00857ab06 (7004a2e6-908e-4a17-a634-e0c00857ab06): created successfully Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab2e1d-ac72-4074-9726-64cba902466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Flow 'volume_create_manager' (b2aabfe5-1070-4a3a-bad3-dcd04f193ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:24 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f Sep 30 19:49:24 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:24 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ea471f66-f58b-4410-9500-9246d34bd933 tempest-ProjectReaderTests-478577947 None] Created volume successfully. Sep 30 19:49:24 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.302s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:49:24 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f" returned: 0 in 0.404s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[256084dd-9131-4a92-b5eb-8cd104befa31]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:24 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d Sep 30 19:49:24 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:25 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" returned: 0 in 0.567s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:25 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f Sep 30 19:49:25 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Acquiring lock "cinder-7004a2e6-908e-4a17-a634-e0c00857ab06-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Lock "cinder-7004a2e6-908e-4a17-a634-e0c00857ab06-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Acquiring lock "cinder-quobyte-7004a2e6-908e-4a17-a634-e0c00857ab06" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Lock "cinder-quobyte-7004a2e6-908e-4a17-a634-e0c00857ab06" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a775231e-734e-40aa-9bfb-070b2064ba8a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:25 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f" returned: 0 in 0.363s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:25 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06 Sep 30 19:49:25 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:25 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f Sep 30 19:49:25 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:25 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d.fbee613c-3d33-46ce-b777-2830abdbd60f" returned: 0 in 0.244s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:25 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06" returned: 0 in 0.370s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-fbee613c-3d33-46ce-b777-2830abdbd60f" released by "_delete_snapshot" :: held 1.732s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" released by "delete_snapshot" :: held 1.769s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:25 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06 Sep 30 19:49:25 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Created reservations ['daf6fdba-803f-4710-96c7-ab65388b21e9', '2549cb2b-b88c-47c3-9e7f-4527b202be85', '11d53d50-4d35-4369-98e4-0e4538e5cfcf', 'a944da7b-0153-44ba-8bfb-7c883d2604cc'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:25 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Delete snapshot completed successfully. Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-fbee613c-3d33-46ce-b777-2830abdbd60f-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Snapshots deleted, issuing volume delete {{(pid=87426) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f480c2a-e038-4207-953c-227904766458]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:25 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7004a2e6-908e-4a17-a634-e0c00857ab06" returned: 0 in 0.253s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Lock "cinder-quobyte-7004a2e6-908e-4a17-a634-e0c00857ab06" released by "delete_volume" :: held 0.668s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Created reservations ['704d6827-8254-4e32-b59d-86ec82eaa430', 'd29d829a-fdc4-4bc8-a6a3-96389a71cd2d', 'dcc9183a-aca9-4122-8b7b-ba3a8ac632c3', 'b301e6cb-0747-444f-8be3-4a6a1d3283b6'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:26 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d Sep 30 19:49:26 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:26 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:49:26 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:26 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" returned: 0 in 0.401s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:26 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d Sep 30 19:49:26 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:26 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.282s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:49:26 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Deleted volume successfully. Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0e15beed-69d2-404c-aaec-197a55499ea0 tempest-ProjectReaderTests-478577947 None] Lock "cinder-7004a2e6-908e-4a17-a634-e0c00857ab06-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:26 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-a39f9ed3-544e-436c-a529-b8a7e83a4e8d" released by "delete_volume" :: held 0.744s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Created reservations ['9ba85379-675f-4089-8ee3-005ca4bbc44c', '29f3d520-cbad-4fbd-be5d-97a330413173', '6a4dddee-0f3d-45a7-9aa6-02082cabad6b', '4a3e5ad4-7c34-49f4-991c-bd2ecaaf0572'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:26 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:49:26 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Flow 'volume_create_manager' (e77e2a3a-0776-4752-ba8a-1c4bee02072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790b0f44-9238-4e39-a3bf-6eabb19bf03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790b0f44-9238-4e39-a3bf-6eabb19bf03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890384272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69a9d1f-6a5e-4ce7-ae92-d1183352bc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca560dff78e4d7b80f19d7f822ff62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:27Z,use_quota=True,user_id='72bc9f7e987849ec8aa1a97f31969bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6f0d1b-0338-41ae-9903-aed791ef910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6f0d1b-0338-41ae-9903-aed791ef910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484919d2-b291-4658-a6ac-65403876c815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484919d2-b291-4658-a6ac-65403876c815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd69a9d1f-6a5e-4ce7-ae92-d1183352bc15', 'volume_name': 'volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b22b06-f19f-429e-9a3f-1a8962c1bdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b22b06-f19f-429e-9a3f-1a8962c1bdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6109d71-7b89-4a1f-941a-80590ee00bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:26 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Volume d69a9d1f-6a5e-4ce7-ae92-d1183352bc15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15', 'volume_size': 1} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890384272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69a9d1f-6a5e-4ce7-ae92-d1183352bc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca560dff78e4d7b80f19d7f822ff62a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:27Z,use_quota=True,user_id='72bc9f7e987849ec8aa1a97f31969bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Creating volume d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:49:26 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:49:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:26 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 1073741824 Sep 30 19:49:26 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:27 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:49:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Deleted volume successfully. Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-083a4d5c-0bc6-4251-9406-3a0daa3d7fea tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-a39f9ed3-544e-436c-a529-b8a7e83a4e8d-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-f045620c-b3f5-441e-980f-2c517c2dbd66-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-f045620c-b3f5-441e-980f-2c517c2dbd66-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "cinder-quobyte-f045620c-b3f5-441e-980f-2c517c2dbd66" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-f045620c-b3f5-441e-980f-2c517c2dbd66" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a4813-bc83-4a9d-8b58-1b549a49152a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:27 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 1073741824" returned: 0 in 0.483s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:27 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 Sep 30 19:49:27 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:27 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 Sep 30 19:49:27 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:27 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66" returned: 0 in 0.386s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:27 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15" returned: 0 in 0.276s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:27 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66 Sep 30 19:49:27 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6109d71-7b89-4a1f-941a-80590ee00bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb95385-aa61-4f8a-8dd8-356c369c5f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Volume volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 (d69a9d1f-6a5e-4ce7-ae92-d1183352bc15): created successfully Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb95385-aa61-4f8a-8dd8-356c369c5f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Flow 'volume_create_manager' (e77e2a3a-0776-4752-ba8a-1c4bee02072f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-93dfdae4-6795-4d44-8656-5fb2a438bd99 tempest-ProjectReaderTests-478577947 None] Created volume successfully. Sep 30 19:49:27 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f045620c-b3f5-441e-980f-2c517c2dbd66" returned: 0 in 0.261s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-quobyte-f045620c-b3f5-441e-980f-2c517c2dbd66" released by "delete_volume" :: held 0.690s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Created reservations ['44598835-3275-4d04-86ea-ed7810bee052', '4312a04f-b5bb-4932-8d80-0e11c1f256a0', '4ad6aa85-f7b9-4672-8324-813c18de24c7', '984b167b-65dd-49f1-8084-b88ce5a2ba58'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:28 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:49:28 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:28 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.261s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:49:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Deleted volume successfully. Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f9560f1d-e849-4b4d-88fa-825378da733a tempest-VolumesDeleteCascade-160354790 None] Lock "cinder-f045620c-b3f5-441e-980f-2c517c2dbd66-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-95656976-4e92-4dac-b665-834347d7370a req-5bc0949e-8c11-43cf-b706-1fb085422318 tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-95656976-4e92-4dac-b665-834347d7370a req-5bc0949e-8c11-43cf-b706-1fb085422318 tempest-TestStampPattern-2098654366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-95656976-4e92-4dac-b665-834347d7370a req-5bc0949e-8c11-43cf-b706-1fb085422318 tempest-TestStampPattern-2098654366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-95656976-4e92-4dac-b665-834347d7370a req-5bc0949e-8c11-43cf-b706-1fb085422318 tempest-TestStampPattern-2098654366 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-df8d1ad6-3804-40eb-872f-6f3f541e8348', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04c56035-f53c-442c-892d-e3cc709c6f0f', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:49:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-95656976-4e92-4dac-b665-834347d7370a req-5bc0949e-8c11-43cf-b706-1fb085422318 tempest-TestStampPattern-2098654366 None] attachment_update completed successfully. Sep 30 19:49:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Acquiring lock "cinder-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Lock "cinder-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Acquiring lock "cinder-quobyte-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Lock "cinder-quobyte-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[173c3d3f-b232-4ee5-8215-5a36cf191db5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:29 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 Sep 30 19:49:29 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:29 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15" returned: 0 in 0.428s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:29 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15 Sep 30 19:49:29 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:29 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15" returned: 0 in 0.327s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Lock "cinder-quobyte-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15" released by "delete_volume" :: held 0.815s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:29 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Created reservations ['bbce7c0a-350c-4170-8d13-28f39494eca0', '36cd3459-d026-4cf5-991f-bc099933ad55', 'e95571eb-4265-4b3d-823c-cf01e39b55c6', 'd097bb32-bfe3-42b2-99b5-04ab9ae0147d'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:30 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:49:30 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:30 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.338s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:30 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:49:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Deleted volume successfully. Sep 30 19:49:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7dd69ec9-7569-47d5-a5ea-fd2be8a41b14 tempest-ProjectReaderTests-478577947 None] Lock "cinder-d69a9d1f-6a5e-4ce7-ae92-d1183352bc15-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:32 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:49:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Flow 'volume_create_manager' (92c65f14-1c99-4a62-9468-523158afc1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1425ebd-72ef-4ef6-8c85-07d509cee6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1425ebd-72ef-4ef6-8c85-07d509cee6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1564834941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3717abbf-7f7c-47a3-8594-ab82c400b7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022a7b8a7f2a4147a05c5b3d409f214e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:33Z,use_quota=True,user_id='5c913822d9c14e488cefe48f396f92ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d23e8b-c557-4754-92e8-04df8bbc59c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d23e8b-c557-4754-92e8-04df8bbc59c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c83676-1ca3-4262-b686-2ee9b417bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c83676-1ca3-4262-b686-2ee9b417bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3717abbf-7f7c-47a3-8594-ab82c400b7b8', 'volume_name': 'volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e95d7b5-6197-4a1c-bed4-aa57ea40581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e95d7b5-6197-4a1c-bed4-aa57ea40581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206af882-dae9-4875-99e9-2cabf1c03e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:33 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Volume 3717abbf-7f7c-47a3-8594-ab82c400b7b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8', 'volume_size': 1} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1564834941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3717abbf-7f7c-47a3-8594-ab82c400b7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022a7b8a7f2a4147a05c5b3d409f214e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:33Z,use_quota=True,user_id='5c913822d9c14e488cefe48f396f92ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Creating volume 3717abbf-7f7c-47a3-8594-ab82c400b7b8 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:49:33 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:33 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 1073741824 Sep 30 19:49:33 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:33 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 1073741824" returned: 0 in 0.435s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:33 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 Sep 30 19:49:33 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:33 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8" returned: 0 in 0.253s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206af882-dae9-4875-99e9-2cabf1c03e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494844a1-0b83-4d90-9bf8-b36806f8ac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:33 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Volume volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 (3717abbf-7f7c-47a3-8594-ab82c400b7b8): created successfully Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494844a1-0b83-4d90-9bf8-b36806f8ac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Flow 'volume_create_manager' (92c65f14-1c99-4a62-9468-523158afc1ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:33 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1e8b843d-4ea2-4e92-b0e3-d3045973fac3 tempest-VolumesMetadataTest-193217575 None] Created volume successfully. Sep 30 19:49:34 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-46e6e22d-596a-43d8-8e1b-045c78d304e2 req-f6d2e09f-ca74-464c-a2f8-87d3285c78bf tempest-TestStampPattern-2098654366 None] Terminate volume connection completed successfully. Sep 30 19:49:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-46e6e22d-596a-43d8-8e1b-045c78d304e2 req-f6d2e09f-ca74-464c-a2f8-87d3285c78bf tempest-TestStampPattern-2098654366 None] Deleting attachment 04c56035-f53c-442c-892d-e3cc709c6f0f. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:49:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Acquiring lock "cinder-3717abbf-7f7c-47a3-8594-ab82c400b7b8-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Lock "cinder-3717abbf-7f7c-47a3-8594-ab82c400b7b8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Acquiring lock "cinder-quobyte-3717abbf-7f7c-47a3-8594-ab82c400b7b8" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Lock "cinder-quobyte-3717abbf-7f7c-47a3-8594-ab82c400b7b8" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:34 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9908376e-5de6-4afb-94ee-e3cc33339b69]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:34 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 Sep 30 19:49:34 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:35 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8" returned: 0 in 0.384s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Creating offline snapshot 210c6181-820e-4af7-8f34-4c683a12e0bc of volume df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:49:35 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8 Sep 30 19:49:35 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[89052c68-a2a9-46ea-ad00-15d6a26c1859]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:35 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 Sep 30 19:49:35 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:35 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3717abbf-7f7c-47a3-8594-ab82c400b7b8" returned: 0 in 0.258s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Lock "cinder-quobyte-3717abbf-7f7c-47a3-8594-ab82c400b7b8" released by "delete_volume" :: held 0.681s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Created reservations ['63f88bd3-2b56-4c3e-8dc0-4e681fb4b531', '337f60f1-ae4a-4205-9309-8b2d2edb8bfc', '8755e246-8fde-4ec1-982a-2763a42d0bf1', '98f1fa54-83a3-4f63-822a-a846af484361'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:35 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348" returned: 0 in 0.378s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:35 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:35 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:35 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc 1G Sep 30 19:49:35 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:35 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.254s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:49:35 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Deleted volume successfully. Sep 30 19:49:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b2fd1f5-ab8a-40b4-b81f-cf507acfa4c6 tempest-VolumesMetadataTest-193217575 None] Lock "cinder-3717abbf-7f7c-47a3-8594-ab82c400b7b8-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:36 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc 1G" returned: 0 in 0.446s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:36 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc Sep 30 19:49:36 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:36 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc" returned: 0 in 0.311s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:36 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc is being set with open permissions: ugo+rw Sep 30 19:49:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:36 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc Sep 30 19:49:36 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:36 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:36 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.info Sep 30 19:49:36 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:36 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.info" returned: 0 in 0.299s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:36 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.info is being set with open permissions: ugo+rw Sep 30 19:49:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:36 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.info Sep 30 19:49:36 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:37 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.info" returned: 0 in 0.256s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:37 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7d3794cb-bb6f-4805-9d53-f59a045b48e0 tempest-TestStampPattern-2098654366 None] Create snapshot completed successfully Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Flow 'volume_create_manager' (66d29bbd-446b-4ca0-bab2-e26821b6e8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e1413b-1019-4e63-b96a-c892209c8cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e1413b-1019-4e63-b96a-c892209c8cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-205766224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72da547-4f32-47ca-910d-1518c029e5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435c3452abe44fce9735003562317a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=210c6181-820e-4af7-8f34-4c683a12e0bc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:46Z,use_quota=True,user_id='0e9755b7ff8b4b93a461be5c1b323f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c16d24-c3ff-4d6a-b6a9-1922d71eaa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c16d24-c3ff-4d6a-b6a9-1922d71eaa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f8f015-ffce-427e-898f-9df82657de79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f8f015-ffce-427e-898f-9df82657de79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e72da547-4f32-47ca-910d-1518c029e5a8', 'volume_name': 'volume-e72da547-4f32-47ca-910d-1518c029e5a8', 'volume_size': 1, 'snapshot_id': '210c6181-820e-4af7-8f34-4c683a12e0bc'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d128c0-1a59-4833-ab36-deaa5029467f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d128c0-1a59-4833-ab36-deaa5029467f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a982321d-bb0c-43b5-b2f5-754362a1b43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:46 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Volume e72da547-4f32-47ca-910d-1518c029e5a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e72da547-4f32-47ca-910d-1518c029e5a8', 'volume_size': 1, 'snapshot_id': '210c6181-820e-4af7-8f34-4c683a12e0bc'} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Acquiring lock "cinder-quobyte-210c6181-820e-4af7-8f34-4c683a12e0bc-e72da547-4f32-47ca-910d-1518c029e5a8" by "_create_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-210c6181-820e-4af7-8f34-4c683a12e0bc-e72da547-4f32-47ca-910d-1518c029e5a8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Creating volume e72da547-4f32-47ca-910d-1518c029e5a8 from snapshot 210c6181-820e-4af7-8f34-4c683a12e0bc {{(pid=87426) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Acquiring lock "cinder-quobyte-e72da547-4f32-47ca-910d-1518c029e5a8" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-e72da547-4f32-47ca-910d-1518c029e5a8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] snapshot: 210c6181-820e-4af7-8f34-4c683a12e0bc, volume: e72da547-4f32-47ca-910d-1518c029e5a8, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce59a1-fe41-4847-8521-5126033b77c7]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:46 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc Sep 30 19:49:46 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:46 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc" returned: 0 in 0.457s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8d1ad6-3804-40eb-872f-6f3f541e8348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2598d68a-52b0-4ee5-8b66-b928a016e4cb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:49:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:47 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 Sep 30 19:49:47 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:47 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348" returned: 0 in 0.441s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:49:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:49:47 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:49:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:47 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 Sep 30 19:49:47 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Flow 'volume_create_manager' (e1527435-e3b4-4920-a9e6-45cca5425d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4ba930-a896-4e92-96a6-04b5cca31c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4ba930-a896-4e92-96a6-04b5cca31c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1568103924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd85e45-47bb-4554-a338-31ef7c10dca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d86ac988a16480b84b123fec0db9910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:49Z,use_quota=True,user_id='888229bca7ef43a1b76114a6fd0fb7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb107f4-8c81-4946-a8be-ca5e39131236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb107f4-8c81-4946-a8be-ca5e39131236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf73e04-7c09-4a07-92fd-5f62a33b4867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf73e04-7c09-4a07-92fd-5f62a33b4867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd85e45-47bb-4554-a338-31ef7c10dca6', 'volume_name': 'volume-afd85e45-47bb-4554-a338-31ef7c10dca6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fed6614-1135-4ff3-95f5-5253263df695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fed6614-1135-4ff3-95f5-5253263df695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20d0b73-4705-461e-8cf5-142f714e0b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:49 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Volume afd85e45-47bb-4554-a338-31ef7c10dca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd85e45-47bb-4554-a338-31ef7c10dca6', 'volume_size': 1} Sep 30 19:49:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:55 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8" returned: 0 in 8.570s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:55 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:49:55 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Converted 1024.00 MB image at 119.48 MB/s Sep 30 19:49:55 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 is being set with open permissions: ugo+rw Sep 30 19:49:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:55 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 Sep 30 19:49:55 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:56 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8" returned: 0 in 0.431s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-e72da547-4f32-47ca-910d-1518c029e5a8" released by "_copy_volume_from_snapshot" :: held 10.027s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-210c6181-820e-4af7-8f34-4c683a12e0bc-e72da547-4f32-47ca-910d-1518c029e5a8" released by "_create_volume_from_snapshot" :: held 10.131s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.150s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.771s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1568103924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd85e45-47bb-4554-a338-31ef7c10dca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d86ac988a16480b84b123fec0db9910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:49:49Z,use_quota=True,user_id='888229bca7ef43a1b76114a6fd0fb7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Creating volume afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:49:56 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:56 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 1073741824 Sep 30 19:49:56 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a982321d-bb0c-43b5-b2f5-754362a1b43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72da547-4f32-47ca-910d-1518c029e5a8', 'volume_size': 1, 'snapshot_id': '210c6181-820e-4af7-8f34-4c683a12e0bc'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ab7b75-d20b-4dd2-8dcb-abaa3b491c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Volume volume-e72da547-4f32-47ca-910d-1518c029e5a8 (e72da547-4f32-47ca-910d-1518c029e5a8): created successfully Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ab7b75-d20b-4dd2-8dcb-abaa3b491c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Flow 'volume_create_manager' (66d29bbd-446b-4ca0-bab2-e26821b6e8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-12285037-ce4d-4f84-8494-e53c1749bc6c tempest-TestStampPattern-2098654366 None] Created volume successfully. Sep 30 19:49:57 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 1073741824" returned: 0 in 0.554s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:49:57 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 Sep 30 19:49:57 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:49:57 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 30 19:49:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6" returned: 0 in 0.266s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:49:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:49:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:49:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20d0b73-4705-461e-8cf5-142f714e0b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd85e45-47bb-4554-a338-31ef7c10dca6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abd9b41-e980-4986-8edc-85f825c02ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:49:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Volume volume-afd85e45-47bb-4554-a338-31ef7c10dca6 (afd85e45-47bb-4554-a338-31ef7c10dca6): created successfully Sep 30 19:49:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1abd9b41-e980-4986-8edc-85f825c02ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:49:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Flow 'volume_create_manager' (e1527435-e3b4-4920-a9e6-45cca5425d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:49:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5a79c149-a570-468c-b021-8ac70b666be2 tempest-VolumesActionsTest-239765449 None] Created volume successfully. Sep 30 19:50:07 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=71,cinder:INSERT=16,cinder:SELECT=50,cinder:DELETE=7 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:50:07 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=66,cinder:SELECT=62,cinder:DELETE=5,cinder:INSERT=14 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:50:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-22cf45ba-e769-451d-98a6-7ceb395c3066 tempest-VolumesActionsTest-239765449 None] Acquiring lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6" by "attach_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:50:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-22cf45ba-e769-451d-98a6-7ceb395c3066 tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6" acquired by "attach_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:50:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-22cf45ba-e769-451d-98a6-7ceb395c3066 tempest-VolumesActionsTest-239765449 None] Attaching volume afd85e45-47bb-4554-a338-31ef7c10dca6 to instance d6a4bad0-0b49-43d5-b4c9-77d539a3da42 at mountpoint /dev/vdb on host None. Sep 30 19:50:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-22cf45ba-e769-451d-98a6-7ceb395c3066 tempest-VolumesActionsTest-239765449 None] Attach volume completed successfully. Sep 30 19:50:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-22cf45ba-e769-451d-98a6-7ceb395c3066 tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6" released by "attach_volume" :: held 0.085s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:50:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f0ea6944-3295-4224-ba17-c099f7d4b6e8 tempest-VolumesActionsTest-239765449 None] Acquiring lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6-detach_volume" by "detach_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:50:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f0ea6944-3295-4224-ba17-c099f7d4b6e8 tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:50:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f0ea6944-3295-4224-ba17-c099f7d4b6e8 tempest-VolumesActionsTest-239765449 None] Detaching volume afd85e45-47bb-4554-a338-31ef7c10dca6 from instance d6a4bad0-0b49-43d5-b4c9-77d539a3da42. Sep 30 19:50:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f0ea6944-3295-4224-ba17-c099f7d4b6e8 tempest-VolumesActionsTest-239765449 None] Detach volume completed successfully. Sep 30 19:50:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f0ea6944-3295-4224-ba17-c099f7d4b6e8 tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:50:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fd9970c-083a-4792-81d8-aacaf6d87cc0 tempest-VolumesActionsTest-239765449 None] Acquiring lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6" by "attach_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:50:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fd9970c-083a-4792-81d8-aacaf6d87cc0 tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6" acquired by "attach_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:50:17 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0fd9970c-083a-4792-81d8-aacaf6d87cc0 tempest-VolumesActionsTest-239765449 None] Attaching volume afd85e45-47bb-4554-a338-31ef7c10dca6 to instance ce619a48-f33b-46b7-8a4f-a829e36595fb at mountpoint /dev/vdb on host None. Sep 30 19:50:17 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0fd9970c-083a-4792-81d8-aacaf6d87cc0 tempest-VolumesActionsTest-239765449 None] Attach volume completed successfully. Sep 30 19:50:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fd9970c-083a-4792-81d8-aacaf6d87cc0 tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6" released by "attach_volume" :: held 0.097s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:50:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8ce9c186-1c31-4036-a295-a37ecb782d1b tempest-VolumesActionsTest-239765449 None] Acquiring lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6-detach_volume" by "detach_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:50:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8ce9c186-1c31-4036-a295-a37ecb782d1b tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:50:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8ce9c186-1c31-4036-a295-a37ecb782d1b tempest-VolumesActionsTest-239765449 None] Detaching volume afd85e45-47bb-4554-a338-31ef7c10dca6 from instance ce619a48-f33b-46b7-8a4f-a829e36595fb. Sep 30 19:50:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8ce9c186-1c31-4036-a295-a37ecb782d1b tempest-VolumesActionsTest-239765449 None] Detach volume completed successfully. Sep 30 19:50:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8ce9c186-1c31-4036-a295-a37ecb782d1b tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:50:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:50:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:50:22 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae2f1c8-2657-4f36-b562-f27051ac2cb0]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:50:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:22 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 Sep 30 19:50:22 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:22 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6" returned: 0 in 0.363s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:22 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae1c83c-dd70-4241-9c9e-fe68e3cae063]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:50:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:22 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 Sep 30 19:50:22 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:23 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6" returned: 0 in 0.366s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.c655d844-0720-4cac-9677-1a2a12634e240a8y5gh6.img {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:23 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.c655d844-0720-4cac-9677-1a2a12634e240a8y5gh6.img Sep 30 19:50:23 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:50:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:50:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:50:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:50:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:50:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:50:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:24 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:50:24 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:24 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.519s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:50:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:50:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:50:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:50:28 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=5 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:50:29 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.c655d844-0720-4cac-9677-1a2a12634e240a8y5gh6.img" returned: 0 in 5.860s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[72997d4e-fb97-422a-92c5-06725cd7e5d5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:50:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:29 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 Sep 30 19:50:29 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:29 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6" returned: 0 in 0.517s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:29 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.c655d844-0720-4cac-9677-1a2a12634e240a8y5gh6.img {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:50:29 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Converted 1024.00 MB image at 174.71 MB/s Sep 30 19:50:29 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] c655d844-0720-4cac-9677-1a2a12634e24 was raw, no need to convert to raw {{(pid=87426) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 30 19:50:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-bb57d1d3-fe61-42c9-8aad-6824aa7e554b req-c9790660-3c53-4762-a770-cef51dee8319 tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:50:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.362s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:50:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Uploaded volume to glance image-id: c655d844-0720-4cac-9677-1a2a12634e24. {{(pid=87426) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 30 19:50:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-bb57d1d3-fe61-42c9-8aad-6824aa7e554b req-c9790660-3c53-4762-a770-cef51dee8319 tempest-TestStampPattern-2098654366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.945s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:50:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-bb57d1d3-fe61-42c9-8aad-6824aa7e554b req-c9790660-3c53-4762-a770-cef51dee8319 tempest-TestStampPattern-2098654366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:50:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7ed89c5a-1bbf-4373-9ac3-4ea1aee0891a tempest-VolumesActionsTest-239765449 None] Copy volume to image completed successfully. Sep 30 19:50:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-bb57d1d3-fe61-42c9-8aad-6824aa7e554b req-c9790660-3c53-4762-a770-cef51dee8319 tempest-TestStampPattern-2098654366 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-e72da547-4f32-47ca-910d-1518c029e5a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc5523c3-4dcb-4539-82ad-0aeadce8e57f', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:50:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-bb57d1d3-fe61-42c9-8aad-6824aa7e554b req-c9790660-3c53-4762-a770-cef51dee8319 tempest-TestStampPattern-2098654366 None] attachment_update completed successfully. Sep 30 19:50:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:50:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:50:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0355b46c-78e5-4081-890b-2260da9e4982]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:50:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:50 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 Sep 30 19:50:50 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:50 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6" returned: 0 in 0.445s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:50 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d275a3-3c2b-4270-b596-76582b258685]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:50:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:50 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 Sep 30 19:50:50 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:51 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6" returned: 0 in 0.373s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:51 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img Sep 30 19:50:51 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-89ab66f4-6eea-432e-8ec2-71bc2378146d req-672f346c-a1d4-4e53-835d-b77b115a4584 tempest-TestStampPattern-2098654366 None] Terminate volume connection completed successfully. Sep 30 19:50:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-89ab66f4-6eea-432e-8ec2-71bc2378146d req-672f346c-a1d4-4e53-835d-b77b115a4584 tempest-TestStampPattern-2098654366 None] Deleting attachment bc5523c3-4dcb-4539-82ad-0aeadce8e57f. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:50:58 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img" returned: 0 in 7.709s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d0e45-b48f-437c-9075-984b9576ef5f]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:50:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:58 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 Sep 30 19:50:58 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Acquiring lock "cinder-e72da547-4f32-47ca-910d-1518c029e5a8-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Lock "cinder-e72da547-4f32-47ca-910d-1518c029e5a8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Acquiring lock "cinder-quobyte-e72da547-4f32-47ca-910d-1518c029e5a8" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-e72da547-4f32-47ca-910d-1518c029e5a8" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d68774a-f74a-4920-9691-2d52efb63fb9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:59 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6" returned: 0 in 0.539s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6, size 1024.00 MB, duration 7.71 sec, destination /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:50:59 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Converted 1024.00 MB image at 132.82 MB/s Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] 859e57fb-57f1-4dd6-8586-7fa47356174b was raw, converting to qcow2 {{(pid=87426) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3dc596-e733-4071-ac9a-1eac1dd2ca6c]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:59 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 Sep 30 19:50:59 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:59 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img Sep 30 19:50:59 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:59 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8" returned: 0 in 0.373s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:59 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8 Sep 30 19:50:59 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:59 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img" returned: 0 in 0.342s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:50:59 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img Sep 30 19:50:59 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:50:59 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e72da547-4f32-47ca-910d-1518c029e5a8" returned: 0 in 0.268s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:50:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-e72da547-4f32-47ca-910d-1518c029e5a8" released by "delete_volume" :: held 0.687s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Created reservations ['671c3a4a-5438-4000-83e8-4e5af1968467', '34bfd66a-5f51-492e-8202-db5b8f1b36da', 'c1be5a8a-4fa2-486d-aee1-a7f413ef96e6', 'b0d8006c-f751-4c91-aeae-8a9373a21950'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:00 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img" returned: 1 in 0.340s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img /opt/stack/data/cinder/conversion/vol_upload_x5lzci10 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:00 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img /opt/stack/data/cinder/conversion/vol_upload_x5lzci10 Sep 30 19:51:00 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:00 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:00 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:00 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.285s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:00 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img /opt/stack/data/cinder/conversion/vol_upload_x5lzci10" returned: 0 in 0.317s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Image conversion details: src /opt/stack/data/cinder/conversion/afd85e45-47bb-4554-a338-31ef7c10dca6.temp_image.859e57fb-57f1-4dd6-8586-7fa47356174bhz9drm3j.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_x5lzci10 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:51:00 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[454cae64-05a9-4861-a0bc-73a8796c3d2c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x5lzci10 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Deleted volume successfully. Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8e53be55-d3f7-4b94-ad4e-e6db801633cd tempest-TestStampPattern-2098654366 None] Lock "cinder-e72da547-4f32-47ca-910d-1518c029e5a8-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:00 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x5lzci10 Sep 30 19:51:00 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Acquiring lock "cinder-210c6181-820e-4af7-8f34-4c683a12e0bc-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Lock "cinder-210c6181-820e-4af7-8f34-4c683a12e0bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Acquiring lock "cinder-quobyte-df8d1ad6-3804-40eb-872f-6f3f541e8348" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-df8d1ad6-3804-40eb-872f-6f3f541e8348" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Acquiring lock "cinder-quobyte-210c6181-820e-4af7-8f34-4c683a12e0bc" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-210c6181-820e-4af7-8f34-4c683a12e0bc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Deleting offline snapshot 210c6181-820e-4af7-8f34-4c683a12e0bc of volume df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] snapshot_file for this snap is: volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8ec7e9-341e-4c22-b266-ef56ce0f4855]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:00 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x5lzci10" returned: 0 in 0.381s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:00 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc Sep 30 19:51:00 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:01 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc" returned: 0 in 0.376s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8d1ad6-3804-40eb-872f-6f3f541e8348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:51:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8041dd9-a1ad-431d-9c5c-b4df308c20cb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:01 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 Sep 30 19:51:01 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:01 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348" returned: 0 in 0.528s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:01 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc Sep 30 19:51:01 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:02 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc" returned: 0 in 0.356s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:02 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc Sep 30 19:51:02 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.846s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Uploaded volume to glance image-id: 859e57fb-57f1-4dd6-8586-7fa47356174b. {{(pid=87426) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 30 19:51:02 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0231b9d3-866b-4377-813a-5fe4662e8c3f tempest-VolumesActionsTest-239765449 None] Copy volume to image completed successfully. Sep 30 19:51:02 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348.210c6181-820e-4af7-8f34-4c683a12e0bc" returned: 0 in 0.253s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-210c6181-820e-4af7-8f34-4c683a12e0bc" released by "_delete_snapshot" :: held 1.641s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-df8d1ad6-3804-40eb-872f-6f3f541e8348" released by "delete_snapshot" :: held 1.664s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:02 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Created reservations ['f6c5726e-1f48-44a4-9d74-390d6dbed0fa', 'e3c971ec-adfc-4dee-a57a-679f7a3d7f0a', '76358a6f-2ab2-4929-8eff-032b5266a6ee', '087c29e1-cfca-458d-8b92-0c98e33705f4'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:02 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Delete snapshot completed successfully. Sep 30 19:51:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-021b134d-5b64-4c36-b4d6-ec4d151b6649 tempest-TestStampPattern-2098654366 None] Lock "cinder-210c6181-820e-4af7-8f34-4c683a12e0bc-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Acquiring lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Acquiring lock "cinder-quobyte-afd85e45-47bb-4554-a338-31ef7c10dca6" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Lock "cinder-quobyte-afd85e45-47bb-4554-a338-31ef7c10dca6" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[da51f7b2-9872-4fbe-80c4-5121176001f5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:03 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 Sep 30 19:51:03 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:04 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6" returned: 0 in 0.478s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:04 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6 Sep 30 19:51:04 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:04 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-afd85e45-47bb-4554-a338-31ef7c10dca6" returned: 0 in 0.377s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Lock "cinder-quobyte-afd85e45-47bb-4554-a338-31ef7c10dca6" released by "delete_volume" :: held 0.912s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Created reservations ['287c41a8-e106-4ab6-8859-9af2138126be', 'd4fae1a7-6783-484f-9212-8e075d134a84', '7d1e9b42-4a40-4c44-9475-8ab01a449e19', 'a5101cb7-9ce5-4325-8829-bc18a802a040'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:04 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:04 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:04 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:04 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:04 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Deleted volume successfully. Sep 30 19:51:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eaf4619-2283-46ea-b62d-4e080cbebf47 tempest-VolumesActionsTest-239765449 None] Lock "cinder-afd85e45-47bb-4554-a338-31ef7c10dca6-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Acquiring lock "cinder-df8d1ad6-3804-40eb-872f-6f3f541e8348-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Lock "cinder-df8d1ad6-3804-40eb-872f-6f3f541e8348-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Acquiring lock "cinder-quobyte-df8d1ad6-3804-40eb-872f-6f3f541e8348" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-df8d1ad6-3804-40eb-872f-6f3f541e8348" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:06 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fe256b-377e-478c-a0e1-ac983d3eeb59]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:06 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 Sep 30 19:51:06 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:07 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348" returned: 0 in 0.422s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:07 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348 Sep 30 19:51:07 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:07 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-df8d1ad6-3804-40eb-872f-6f3f541e8348" returned: 0 in 0.255s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Lock "cinder-quobyte-df8d1ad6-3804-40eb-872f-6f3f541e8348" released by "delete_volume" :: held 0.748s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=50,cinder:INSERT=5,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Created reservations ['9d16a5ff-7b71-4137-9ce9-092e6117110d', '41582378-d9dd-47df-a166-a7799759d420', 'd9ec592e-0750-4df0-9fb5-498294a6975a', '4b90f99a-e3af-434a-a20c-71b551642e7d'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:07 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:07 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:07 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Deleted volume successfully. Sep 30 19:51:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8c45bb59-80ae-4599-8341-780d7d29ab73 tempest-TestStampPattern-2098654366 None] Lock "cinder-df8d1ad6-3804-40eb-872f-6f3f541e8348-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:12 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:51:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Flow 'volume_create_manager' (e8d3bb10-8d2c-4769-b0f0-c1c4a7f6ea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84659720-dc0e-4e59-a65f-1b075c0fe96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84659720-dc0e-4e59-a65f-1b075c0fe96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-220852847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f99aa25-1cb1-42fc-9f27-143530a629e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b6256f9676485ba90e5b3cdead22c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:13Z,use_quota=True,user_id='210371863192400dad54b8fcec8f3f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21af6262-1c47-43df-b05d-c7d9d69059a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21af6262-1c47-43df-b05d-c7d9d69059a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916c6e74-127f-4404-b402-a013ee965c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:12 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916c6e74-127f-4404-b402-a013ee965c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f99aa25-1cb1-42fc-9f27-143530a629e2', 'volume_name': 'volume-2f99aa25-1cb1-42fc-9f27-143530a629e2', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946db73b-2e31-4fb3-992b-5ca2797d0319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946db73b-2e31-4fb3-992b-5ca2797d0319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a59885-1dca-46ae-b327-c147ee1c5dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:13 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Volume 2f99aa25-1cb1-42fc-9f27-143530a629e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f99aa25-1cb1-42fc-9f27-143530a629e2', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Trying to clone 2f99aa25-1cb1-42fc-9f27-143530a629e2 from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b at location (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:51:13 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Image download 20.69 MB at 20.69 MB/s Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a958d907-b7b6-48f1-a224-81e0f6f9bf99]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:13 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD Sep 30 19:51:13 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:13 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b is fetched for user 210371863192400dad54b8fcec8f3f85. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[471eb5f0-78bf-4518-8bab-79625302eb20]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:14 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD Sep 30 19:51:14 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:14 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-220852847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f99aa25-1cb1-42fc-9f27-143530a629e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b6256f9676485ba90e5b3cdead22c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:13Z,use_quota=True,user_id='210371863192400dad54b8fcec8f3f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Creating volume 2f99aa25-1cb1-42fc-9f27-143530a629e2 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:51:14 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:14 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 1073741824 Sep 30 19:51:14 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:14 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 1073741824" returned: 0 in 0.451s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:14 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 Sep 30 19:51:14 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:15 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2" returned: 0 in 0.250s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Attempting download of 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume 2f99aa25-1cb1-42fc-9f27-143530a629e2. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20ca47-f435-4c66-bd6a-af1495ace5c6]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_vaph1738 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:15 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_vaph1738 Sep 30 19:51:15 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:15 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_vaph1738" returned: 0 in 0.357s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_vaph1738 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:15 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_vaph1738 Sep 30 19:51:15 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:15 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_vaph1738" returned: 1 in 0.312s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_vaph1738' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd187d0a-f441-444f-85a5-b05a77a2c3ae]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:15 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD Sep 30 19:51:15 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:16 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:16 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] 5be8283e-b86b-4bc8-8baa-e16813f20b2b was qcow2, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:51:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:16 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 Sep 30 19:51:16 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:18 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2" returned: 0 in 2.234s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_rvnvowg9devstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:51:18 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Converted 112.00 MB image at 50.11 MB/s Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:18 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 1G Sep 30 19:51:18 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:18 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 1G" returned: 0 in 0.319s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Downloaded image 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume 2f99aa25-1cb1-42fc-9f27-143530a629e2 successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b for user 210371863192400dad54b8fcec8f3f85 is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Marking volume 2f99aa25-1cb1-42fc-9f27-143530a629e2 as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Copying metadata from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b to 2f99aa25-1cb1-42fc-9f27-143530a629e2. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Creating volume glance metadata for volume 2f99aa25-1cb1-42fc-9f27-143530a629e2 backed by image 5be8283e-b86b-4bc8-8baa-e16813f20b2b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a59885-1dca-46ae-b327-c147ee1c5dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f99aa25-1cb1-42fc-9f27-143530a629e2', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd8b68d-49b1-4219-ba3f-42fe149ead82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:18 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Volume volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 (2f99aa25-1cb1-42fc-9f27-143530a629e2): created successfully Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd8b68d-49b1-4219-ba3f-42fe149ead82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:18 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Flow 'volume_create_manager' (e8d3bb10-8d2c-4769-b0f0-c1c4a7f6ea21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-68b4da49-6325-4bc9-9a28-46f67985ad63 tempest-VolumesExtendTest-1509840506 None] Created volume successfully. Sep 30 19:51:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-31fc1279-d97e-4b03-841b-075a2b1b4fb7 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-31fc1279-d97e-4b03-841b-075a2b1b4fb7 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:19 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[59311ffd-6e9a-4a22-947f-fcc5a5dd73c9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-31fc1279-d97e-4b03-841b-075a2b1b4fb7 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:19 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 Sep 30 19:51:19 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:19 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-31fc1279-d97e-4b03-841b-075a2b1b4fb7 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2" returned: 0 in 0.382s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-31fc1279-d97e-4b03-841b-075a2b1b4fb7 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 2G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-31fc1279-d97e-4b03-841b-075a2b1b4fb7 tempest-VolumesExtendTest-1509840506 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 2G" returned: 0 in 0.111s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-31fc1279-d97e-4b03-841b-075a2b1b4fb7 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.524s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:19 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-31fc1279-d97e-4b03-841b-075a2b1b4fb7 tempest-VolumesExtendTest-1509840506 None] Extend volume completed successfully. Sep 30 19:51:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "cinder-2f99aa25-1cb1-42fc-9f27-143530a629e2-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-2f99aa25-1cb1-42fc-9f27-143530a629e2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "cinder-quobyte-2f99aa25-1cb1-42fc-9f27-143530a629e2" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-quobyte-2f99aa25-1cb1-42fc-9f27-143530a629e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:20 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3b6cc1-5520-4caa-8b9c-32b4ed10b937]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:21 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 Sep 30 19:51:21 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:21 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2" returned: 0 in 0.372s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:21 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2 Sep 30 19:51:21 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:21 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2f99aa25-1cb1-42fc-9f27-143530a629e2" returned: 0 in 0.250s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-quobyte-2f99aa25-1cb1-42fc-9f27-143530a629e2" released by "delete_volume" :: held 0.669s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Created reservations ['e7dbe63f-ae4c-4185-9eb2-71855177fccc', 'b4372fdd-5128-4353-81de-df62e024078b', '65610359-3102-408e-a09b-ea268b2b830e', 'b73e60d0-2825-4788-bf9a-2c16050f2526'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:21 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:21 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:21 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.274s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:21 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Deleted volume successfully. Sep 30 19:51:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-205de9b6-34d6-446b-af86-4a3950c658f9 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-2f99aa25-1cb1-42fc-9f27-143530a629e2-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Flow 'volume_create_manager' (cb21c620-e02f-4d74-bddf-337d7ee7fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76984be-c1b1-4062-96fe-8fcebaaa7017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76984be-c1b1-4062-96fe-8fcebaaa7017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1569853894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30bceab-89ba-4594-9281-354b211d33be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b6256f9676485ba90e5b3cdead22c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:22Z,use_quota=True,user_id='210371863192400dad54b8fcec8f3f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e452fdd6-5f1b-403c-8c86-2b3eda67d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e452fdd6-5f1b-403c-8c86-2b3eda67d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c934d07e-cad8-4f33-8c82-0209607805a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c934d07e-cad8-4f33-8c82-0209607805a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30bceab-89ba-4594-9281-354b211d33be', 'volume_name': 'volume-e30bceab-89ba-4594-9281-354b211d33be', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dc395d-1dc3-4c42-8a5e-c0e7e5015d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dc395d-1dc3-4c42-8a5e-c0e7e5015d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27addaa2-c6f9-432d-a452-17b64f8251ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:22 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Volume e30bceab-89ba-4594-9281-354b211d33be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30bceab-89ba-4594-9281-354b211d33be', 'volume_size': 1} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1569853894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30bceab-89ba-4594-9281-354b211d33be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b6256f9676485ba90e5b3cdead22c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:22Z,use_quota=True,user_id='210371863192400dad54b8fcec8f3f85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Creating volume e30bceab-89ba-4594-9281-354b211d33be {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:51:22 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:51:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:22 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be 1073741824 Sep 30 19:51:22 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:22 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be 1073741824" returned: 0 in 0.448s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:23 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be Sep 30 19:51:23 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:23 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be" returned: 0 in 0.245s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27addaa2-c6f9-432d-a452-17b64f8251ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30bceab-89ba-4594-9281-354b211d33be', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a11c72-1b1d-4b86-859e-7a2302277e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:23 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Volume volume-e30bceab-89ba-4594-9281-354b211d33be (e30bceab-89ba-4594-9281-354b211d33be): created successfully Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a11c72-1b1d-4b86-859e-7a2302277e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Flow 'volume_create_manager' (cb21c620-e02f-4d74-bddf-337d7ee7fccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:23 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7019296a-01b5-41bb-a7ae-3dd26179b31f tempest-VolumesExtendTest-1509840506 None] Created volume successfully. Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Flow 'volume_create_manager' (2ee305d8-8580-42bb-b127-29412a130ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f655c57-75b7-4fac-a947-b9826c2c30c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Creating offline snapshot 4a63fa69-e0c2-488e-872d-e126c9f32891 of volume e30bceab-89ba-4594-9281-354b211d33be {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f655c57-75b7-4fac-a947-b9826c2c30c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0272568e-6bb5-4eb1-a09f-cc0bf324717f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ef23f8921e4ee98fc538b68eb1203f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:24Z,use_quota=True,user_id='863a4ced891f45a4b25db06d6f0688fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97a4eb77-3113-459f-addb-2379eafc03d6),volume_type_id=97a4eb77-3113-459f-addb-2379eafc03d6)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5afe8c-7868-40e7-89cb-4bbee7cfc70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5afe8c-7868-40e7-89cb-4bbee7cfc70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca89832-28e5-41ba-be0a-90667059204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7bb3e0-4d8c-445f-9a27-b75fe186f9e3]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:23 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:23 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:24 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be Sep 30 19:51:24 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca89832-28e5-41ba-be0a-90667059204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0272568e-6bb5-4eb1-a09f-cc0bf324717f', 'volume_name': 'volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f', 'volume_size': 1, 'image_id': '2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6372af570a00d5fe7f7aa54243600b6f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90ef23f8921e4ee98fc538b68eb1203f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33dfaf4835e8e3af00713d0d4080af1718fbcb244c11f35a2078eb358a7a2c193f4a019a4d1bc1a9288b1927493c6e0405097667bcd9ad1d02a5b27fbd0d83fe', 'id': '2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'created_at': datetime.datetime(2026, 9, 30, 17, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 51, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c440dd5-af8e-43ae-8ea1-e2b5554d31d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd44b9d6-aa03-4a32-9785-c0ba916c7e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd44b9d6-aa03-4a32-9785-c0ba916c7e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af31a385-ff99-489b-bbbd-2dae13459d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:24 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Volume 0272568e-6bb5-4eb1-a09f-cc0bf324717f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f', 'volume_size': 1, 'image_id': '2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6372af570a00d5fe7f7aa54243600b6f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90ef23f8921e4ee98fc538b68eb1203f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33dfaf4835e8e3af00713d0d4080af1718fbcb244c11f35a2078eb358a7a2c193f4a019a4d1bc1a9288b1927493c6e0405097667bcd9ad1d02a5b27fbd0d83fe', 'id': '2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'created_at': datetime.datetime(2026, 9, 30, 17, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 51, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c440dd5-af8e-43ae-8ea1-e2b5554d31d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Trying to clone 0272568e-6bb5-4eb1-a09f-cc0bf324717f from image 2c440dd5-af8e-43ae-8ea1-e2b5554d31d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:51:24 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.295s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:51:24 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Image download 0.00 MB at 0.00 MB/s Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e606eae2-38b6-4bd7-a623-20e9a6277c92]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:24 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be" returned: 0 in 0.413s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:24 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 1G Sep 30 19:51:24 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:24 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD Sep 30 19:51:24 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:24 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:24 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 1G" returned: 0 in 0.437s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30bceab-89ba-4594-9281-354b211d33be -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:24 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD Sep 30 19:51:24 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:24 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30bceab-89ba-4594-9281-354b211d33be -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 Sep 30 19:51:24 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:25 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Temporary image 2c440dd5-af8e-43ae-8ea1-e2b5554d31d6 is fetched for user 863a4ced891f45a4b25db06d6f0688fe. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:51:25 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30bceab-89ba-4594-9281-354b211d33be -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891" returned: 0 in 0.307s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:25 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 is being set with open permissions: ugo+rw Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:25 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 Sep 30 19:51:25 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d400457-84dd-49ce-ae10-dd134f62054b]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:25 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD Sep 30 19:51:25 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:25 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891" returned: 0 in 0.249s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:25 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.info Sep 30 19:51:25 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:25 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:25 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD Sep 30 19:51:25 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:25 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.info" returned: 0 in 0.254s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:25 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.info is being set with open permissions: ugo+rw Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:25 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.info Sep 30 19:51:25 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:25 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:25 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.info" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.068s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0272568e-6bb5-4eb1-a09f-cc0bf324717f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ef23f8921e4ee98fc538b68eb1203f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:24Z,use_quota=True,user_id='863a4ced891f45a4b25db06d6f0688fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97a4eb77-3113-459f-addb-2379eafc03d6),volume_type_id=97a4eb77-3113-459f-addb-2379eafc03d6)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Creating volume 0272568e-6bb5-4eb1-a09f-cc0bf324717f {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:51:25 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:51:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:25 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f 1073741824 Sep 30 19:51:25 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:25 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-eae49897-a8bb-4d06-bf6f-5d3d2f73ecbb tempest-VolumesExtendTest-1509840506 None] Create snapshot completed successfully Sep 30 19:51:26 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f 1073741824" returned: 0 in 0.417s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:26 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f Sep 30 19:51:26 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:26 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f" returned: 0 in 0.247s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Attempting download of 2c440dd5-af8e-43ae-8ea1-e2b5554d31d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'metadata': {}}])) to volume 0272568e-6bb5-4eb1-a09f-cc0bf324717f. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[628375f2-da43-4ed5-bbe3-cabb77a7378c]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_gt_1b22h {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:26 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_gt_1b22h Sep 30 19:51:26 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ecfd9a8a-a324-48da-91e9-1378f3381d67 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ecfd9a8a-a324-48da-91e9-1378f3381d67 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[501abbcc-5ac5-4ada-9361-4db57f1ea80e]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecfd9a8a-a324-48da-91e9-1378f3381d67 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:26 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_gt_1b22h" returned: 0 in 0.353s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_gt_1b22h {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:27 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be Sep 30 19:51:27 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:27 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_gt_1b22h Sep 30 19:51:27 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:27 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_gt_1b22h" returned: 1 in 0.337s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_gt_1b22h' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7f13c8-f86c-472a-bc3d-cbccb92c9280]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:27 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecfd9a8a-a324-48da-91e9-1378f3381d67 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be" returned: 0 in 0.382s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecfd9a8a-a324-48da-91e9-1378f3381d67 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 2G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:27 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD Sep 30 19:51:27 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecfd9a8a-a324-48da-91e9-1378f3381d67 tempest-VolumesExtendTest-1509840506 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 2G" returned: 0 in 0.131s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ecfd9a8a-a324-48da-91e9-1378f3381d67 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.555s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ecfd9a8a-a324-48da-91e9-1378f3381d67 tempest-VolumesExtendTest-1509840506 None] Extend volume completed successfully. Sep 30 19:51:27 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:27 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD Sep 30 19:51:27 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:27 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD" returned: 1 in 0.328s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:27 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] 2c440dd5-af8e-43ae-8ea1-e2b5554d31d6 was raw, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:28 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f Sep 30 19:51:28 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "cinder-4a63fa69-e0c2-488e-872d-e126c9f32891-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-4a63fa69-e0c2-488e-872d-e126c9f32891-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "cinder-quobyte-e30bceab-89ba-4594-9281-354b211d33be" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-quobyte-e30bceab-89ba-4594-9281-354b211d33be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "cinder-quobyte-4a63fa69-e0c2-488e-872d-e126c9f32891" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-quobyte-4a63fa69-e0c2-488e-872d-e126c9f32891" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Deleting offline snapshot 4a63fa69-e0c2-488e-872d-e126c9f32891 of volume e30bceab-89ba-4594-9281-354b211d33be {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] snapshot_file for this snap is: volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a60c1-a1b3-4981-b7ca-dfa3db4de960]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:28 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 Sep 30 19:51:28 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:28 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f" returned: 0 in 0.461s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c440dd5-af8e-43ae-8ea1-e2b5554d31d6_6atbkzy2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:51:28 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:28 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f 1G Sep 30 19:51:28 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:28 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891" returned: 0 in 0.397s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e30bceab-89ba-4594-9281-354b211d33be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb5d4b-d9a5-4115-95e8-b8880009549f]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:28 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f 1G" returned: 0 in 0.333s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Downloaded image 2c440dd5-af8e-43ae-8ea1-e2b5554d31d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'metadata': {}}])) to volume 0272568e-6bb5-4eb1-a09f-cc0bf324717f successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Temporary image 2c440dd5-af8e-43ae-8ea1-e2b5554d31d6 for user 863a4ced891f45a4b25db06d6f0688fe is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Marking volume 0272568e-6bb5-4eb1-a09f-cc0bf324717f as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:51:28 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be Sep 30 19:51:28 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Copying metadata from image 2c440dd5-af8e-43ae-8ea1-e2b5554d31d6 to 0272568e-6bb5-4eb1-a09f-cc0bf324717f. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Creating volume glance metadata for volume 0272568e-6bb5-4eb1-a09f-cc0bf324717f backed by image 2c440dd5-af8e-43ae-8ea1-e2b5554d31d6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6372af570a00d5fe7f7aa54243600b6f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af31a385-ff99-489b-bbbd-2dae13459d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f', 'volume_size': 1, 'image_id': '2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6372af570a00d5fe7f7aa54243600b6f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90ef23f8921e4ee98fc538b68eb1203f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33dfaf4835e8e3af00713d0d4080af1718fbcb244c11f35a2078eb358a7a2c193f4a019a4d1bc1a9288b1927493c6e0405097667bcd9ad1d02a5b27fbd0d83fe', 'id': '2c440dd5-af8e-43ae-8ea1-e2b5554d31d6', 'created_at': datetime.datetime(2026, 9, 30, 17, 51, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 51, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c440dd5-af8e-43ae-8ea1-e2b5554d31d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc08133-b3f0-4ccc-ab09-967a3c1bc139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:28 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Volume volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f (0272568e-6bb5-4eb1-a09f-cc0bf324717f): created successfully Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc08133-b3f0-4ccc-ab09-967a3c1bc139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Flow 'volume_create_manager' (2ee305d8-8580-42bb-b127-29412a130ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-4b0c0b5b-0040-4ee7-9f40-62ca6f639075 tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Created volume successfully. Sep 30 19:51:29 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be" returned: 0 in 0.384s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:29 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 Sep 30 19:51:29 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:29 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891" returned: 0 in 0.361s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:29 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891 Sep 30 19:51:29 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:29 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be.4a63fa69-e0c2-488e-872d-e126c9f32891" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-quobyte-4a63fa69-e0c2-488e-872d-e126c9f32891" released by "_delete_snapshot" :: held 1.507s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-quobyte-e30bceab-89ba-4594-9281-354b211d33be" released by "delete_snapshot" :: held 1.529s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:29 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Created reservations ['877b5f7a-6516-41a7-bf68-d265f4081046', '69053c8f-747d-4d10-9b2f-aff53c73eba9', '2c5e6336-1c65-4207-97c2-55933c3f5188', '0ce86d8a-066f-48d9-9012-e496ea25bf0b'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:29 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Delete snapshot completed successfully. Sep 30 19:51:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8eac306a-8c72-4210-96bb-23551945b231 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-4a63fa69-e0c2-488e-872d-e126c9f32891-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Acquiring lock "cinder-0272568e-6bb5-4eb1-a09f-cc0bf324717f-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "cinder-0272568e-6bb5-4eb1-a09f-cc0bf324717f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Acquiring lock "cinder-quobyte-0272568e-6bb5-4eb1-a09f-cc0bf324717f" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "cinder-quobyte-0272568e-6bb5-4eb1-a09f-cc0bf324717f" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec99842-a0e2-41b0-9da6-826b50d681d2]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:30 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f Sep 30 19:51:30 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "cinder-e30bceab-89ba-4594-9281-354b211d33be-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-e30bceab-89ba-4594-9281-354b211d33be-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "cinder-quobyte-e30bceab-89ba-4594-9281-354b211d33be" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-quobyte-e30bceab-89ba-4594-9281-354b211d33be" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ce92a8-898d-4973-9f7e-862c9a59044e]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:30 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f" returned: 0 in 0.395s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:30 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f Sep 30 19:51:30 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:30 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be Sep 30 19:51:30 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:30 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0272568e-6bb5-4eb1-a09f-cc0bf324717f" returned: 0 in 0.246s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "cinder-quobyte-0272568e-6bb5-4eb1-a09f-cc0bf324717f" released by "delete_volume" :: held 0.689s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:30 devstack cinder-volume[87426]: WARNING cinder.quota [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:51:30 devstack cinder-volume[87426]: WARNING cinder.quota [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Created reservations ['99e50296-a40b-4c68-971d-9656e4791cbf', 'b978d1d3-11a1-441f-a533-f903716fc4d5', '42256276-6bea-4c96-8d76-1f97fec089b4', 'e97b04c8-460b-41d9-a6a1-627a9c0fde56'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:30 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be" returned: 0 in 0.390s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:30 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be Sep 30 19:51:30 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:31 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:31 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:31 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e30bceab-89ba-4594-9281-354b211d33be" returned: 0 in 0.254s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-quobyte-e30bceab-89ba-4594-9281-354b211d33be" released by "delete_volume" :: held 0.723s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Created reservations ['23d704b3-ba42-4ef6-af12-9e23de3536bb', '342da845-0732-4a2e-978d-2e066df0e254', '2b4eb77c-6bb3-4784-aaaa-fdf0644cd17f', '260cef1f-b7ad-412c-9366-8fb06f6d7b11'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:31 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.264s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Deleted volume successfully. Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7e47a571-049f-435a-8ab0-72e56992d87e tempest-VolumeAndVolumeTypeFromImageTest-633142056 None] Lock "cinder-0272568e-6bb5-4eb1-a09f-cc0bf324717f-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:31 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:31 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:31 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Deleted volume successfully. Sep 30 19:51:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-eb8a57de-6f16-418d-b560-9b65989b6c31 tempest-VolumesExtendTest-1509840506 None] Lock "cinder-e30bceab-89ba-4594-9281-354b211d33be-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (32d8be47-838e-481e-a03f-1b5ef57189a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1231b5-97c6-4919-98a0-ff58b239fdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1231b5-97c6-4919-98a0-ff58b239fdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-900685530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d2e1dd-d747-4914-a9c9-29348a51f96c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:36Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c9378f-d65d-420c-8aaf-780dfda86d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c9378f-d65d-420c-8aaf-780dfda86d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed41ac3-6d3d-45f4-b06a-186aadddf240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed41ac3-6d3d-45f4-b06a-186aadddf240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d2e1dd-d747-4914-a9c9-29348a51f96c', 'volume_name': 'volume-04d2e1dd-d747-4914-a9c9-29348a51f96c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbceac4f-b7d1-4c88-9aa6-8744edfe8cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbceac4f-b7d1-4c88-9aa6-8744edfe8cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828b115e-4cde-4505-94c3-44909fba6aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:35 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Volume 04d2e1dd-d747-4914-a9c9-29348a51f96c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d2e1dd-d747-4914-a9c9-29348a51f96c', 'volume_size': 1} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-900685530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d2e1dd-d747-4914-a9c9-29348a51f96c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:36Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Creating volume 04d2e1dd-d747-4914-a9c9-29348a51f96c {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:51:35 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:51:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:35 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c 1073741824 Sep 30 19:51:35 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:36 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c 1073741824" returned: 0 in 0.478s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:36 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c Sep 30 19:51:36 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:36 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:51:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828b115e-4cde-4505-94c3-44909fba6aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d2e1dd-d747-4914-a9c9-29348a51f96c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f135cf37-87f1-46d7-849a-156e4d422331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:36 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Volume volume-04d2e1dd-d747-4914-a9c9-29348a51f96c (04d2e1dd-d747-4914-a9c9-29348a51f96c): created successfully Sep 30 19:51:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f135cf37-87f1-46d7-849a-156e4d422331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (32d8be47-838e-481e-a03f-1b5ef57189a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:36 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b288eb73-4078-4612-9589-57fc37cbf993 tempest-VolumesGetTest-748260309 None] Created volume successfully. Sep 30 19:51:37 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:51:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Flow 'volume_create_manager' (63822500-f69d-4764-b0ba-23172b36aa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09e8dba-d30d-4896-bf0e-8ce224aab9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09e8dba-d30d-4896-bf0e-8ce224aab9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1586656d-57fa-433b-ad19-1607ec73599b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cb0c0d81f74155b08f7fca15d676e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:38Z,use_quota=True,user_id='566d6593f8064da19d45b0097d55b887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf1be28-6a4e-4cc0-9315-aafc7cadfb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf1be28-6a4e-4cc0-9315-aafc7cadfb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d619742-ffbe-4017-8fe4-bbb4e69385bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:37 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d619742-ffbe-4017-8fe4-bbb4e69385bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1586656d-57fa-433b-ad19-1607ec73599b', 'volume_name': 'volume-1586656d-57fa-433b-ad19-1607ec73599b', 'volume_size': 1, 'image_id': 'fa9edc20-3785-497c-bbbc-4387f059a380', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa9edc20-3785-497c-bbbc-4387f059a380', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '428cc8326e13fd0e4a332cfff9778256', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55cb0c0d81f74155b08f7fca15d676e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '56c1baed3f4cad652f348e6d9b5b7c1497ecddb35aa66f31fc04d204f29a2b23376874ab1ad8828ea1ea532fd86f07ca6fc1a6ac468861801ede96c8c8c7531c', 'id': 'fa9edc20-3785-497c-bbbc-4387f059a380', 'created_at': datetime.datetime(2026, 9, 30, 17, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 51, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa9edc20-3785-497c-bbbc-4387f059a380/file', 'properties': {}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936738d0-8542-4aa9-8ca9-0853ff14cdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936738d0-8542-4aa9-8ca9-0853ff14cdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b8e998-f283-4e40-83eb-22fef4ab68e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:38 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Volume 1586656d-57fa-433b-ad19-1607ec73599b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1586656d-57fa-433b-ad19-1607ec73599b', 'volume_size': 1, 'image_id': 'fa9edc20-3785-497c-bbbc-4387f059a380', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa9edc20-3785-497c-bbbc-4387f059a380', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '428cc8326e13fd0e4a332cfff9778256', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55cb0c0d81f74155b08f7fca15d676e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '56c1baed3f4cad652f348e6d9b5b7c1497ecddb35aa66f31fc04d204f29a2b23376874ab1ad8828ea1ea532fd86f07ca6fc1a6ac468861801ede96c8c8c7531c', 'id': 'fa9edc20-3785-497c-bbbc-4387f059a380', 'created_at': datetime.datetime(2026, 9, 30, 17, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 51, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa9edc20-3785-497c-bbbc-4387f059a380/file', 'properties': {}}, 'image_service': } Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Trying to clone 1586656d-57fa-433b-ad19-1607ec73599b from image fa9edc20-3785-497c-bbbc-4387f059a380 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa9edc20-3785-497c-bbbc-4387f059a380', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:51:38 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Image download 0.00 MB at 0.00 MB/s Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4159b498-b985-4916-b744-7f53959b951d]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:38 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD Sep 30 19:51:38 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=82,cinder:UPDATE=81,cinder:INSERT=32,cinder:DELETE=5 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (eedf45f4-6366-463f-8e7b-46b317c4fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab77579-7a24-42f1-a43b-059f6eed2609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab77579-7a24-42f1-a43b-059f6eed2609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2043866017',display_name='tempest-VolumesGetTest-Volume-299642366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78488af-509e-4959-9e16-e1432f16a6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:38Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0558467-e414-4d80-b440-8c0310f87f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0558467-e414-4d80-b440-8c0310f87f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d099fec-c0fc-48dc-8884-6a9045c4f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d099fec-c0fc-48dc-8884-6a9045c4f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e78488af-509e-4959-9e16-e1432f16a6c4', 'volume_name': 'volume-e78488af-509e-4959-9e16-e1432f16a6c4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e14d99a-02ac-4364-8fbd-b67ecd8551f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e14d99a-02ac-4364-8fbd-b67ecd8551f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5163df0-9a1a-44fa-8f9f-eaf1011c7617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:38 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Volume e78488af-509e-4959-9e16-e1432f16a6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e78488af-509e-4959-9e16-e1432f16a6c4', 'volume_size': 1} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2043866017',display_name='tempest-VolumesGetTest-Volume-299642366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78488af-509e-4959-9e16-e1432f16a6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:38Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Creating volume e78488af-509e-4959-9e16-e1432f16a6c4 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:51:38 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:38 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4 1073741824 Sep 30 19:51:38 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:38 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:38 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD Sep 30 19:51:38 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:39 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:39 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Temporary image fa9edc20-3785-497c-bbbc-4387f059a380 is fetched for user 566d6593f8064da19d45b0097d55b887. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4 1073741824" returned: 0 in 0.429s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:39 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4 Sep 30 19:51:39 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e23073-b5d1-4e3a-9ccf-a563a0ecf7b0]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:39 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD Sep 30 19:51:39 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:39 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5163df0-9a1a-44fa-8f9f-eaf1011c7617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78488af-509e-4959-9e16-e1432f16a6c4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13438d0-b4f4-45df-aafc-c5ba24aa3048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:39 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Volume volume-e78488af-509e-4959-9e16-e1432f16a6c4 (e78488af-509e-4959-9e16-e1432f16a6c4): created successfully Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13438d0-b4f4-45df-aafc-c5ba24aa3048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (eedf45f4-6366-463f-8e7b-46b317c4fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-354ae8bf-bb13-4603-bebc-4e508a106e22 tempest-VolumesGetTest-748260309 None] Created volume successfully. Sep 30 19:51:39 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:39 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD Sep 30 19:51:39 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-e78488af-509e-4959-9e16-e1432f16a6c4-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Lock "cinder-e78488af-509e-4959-9e16-e1432f16a6c4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-quobyte-e78488af-509e-4959-9e16-e1432f16a6c4" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-e78488af-509e-4959-9e16-e1432f16a6c4" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b2e168-7f9a-47a2-a59e-85f66168018b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:39 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1586656d-57fa-433b-ad19-1607ec73599b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cb0c0d81f74155b08f7fca15d676e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:38Z,use_quota=True,user_id='566d6593f8064da19d45b0097d55b887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Creating volume 1586656d-57fa-433b-ad19-1607ec73599b {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:51:39 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:51:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:39 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b 1073741824 Sep 30 19:51:39 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:39 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4 Sep 30 19:51:39 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:40 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4" returned: 0 in 0.403s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:40 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4 Sep 30 19:51:40 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:40 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b 1073741824" returned: 0 in 0.439s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:40 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b Sep 30 19:51:40 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:40 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e78488af-509e-4959-9e16-e1432f16a6c4" returned: 0 in 0.263s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-e78488af-509e-4959-9e16-e1432f16a6c4" released by "delete_volume" :: held 0.717s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Created reservations ['21c931e6-5738-4c4c-abc2-e16374385187', '659618f9-ca57-4bce-b839-814bd0742597', 'f432f1a3-8581-4873-bbe9-67c75f1ffd8a', '6fca5725-d283-4c20-8c1c-45e85b09eaf2'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:40 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b" returned: 0 in 0.277s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:40 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:40 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Attempting download of fa9edc20-3785-497c-bbbc-4387f059a380 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa9edc20-3785-497c-bbbc-4387f059a380', 'metadata': {}}])) to volume 1586656d-57fa-433b-ad19-1607ec73599b. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49e2cbf-177e-4998-853b-7b0f7cbf57d1]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa9edc20-3785-497c-bbbc-4387f059a380_h7exu880 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:40 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa9edc20-3785-497c-bbbc-4387f059a380_h7exu880 Sep 30 19:51:40 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:40 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.296s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:40 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Deleted volume successfully. Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-04d2e1dd-d747-4914-a9c9-29348a51f96c-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b5e0def3-8f41-4df2-8087-385e8cb37b6b tempest-VolumesGetTest-748260309 None] Lock "cinder-e78488af-509e-4959-9e16-e1432f16a6c4-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Lock "cinder-04d2e1dd-d747-4914-a9c9-29348a51f96c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-quobyte-04d2e1dd-d747-4914-a9c9-29348a51f96c" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-04d2e1dd-d747-4914-a9c9-29348a51f96c" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0098a0a1-cd59-4c3f-a863-f0584a0af841]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:41 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa9edc20-3785-497c-bbbc-4387f059a380_h7exu880" returned: 0 in 0.397s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa9edc20-3785-497c-bbbc-4387f059a380_h7exu880 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:41 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c Sep 30 19:51:41 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:41 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa9edc20-3785-497c-bbbc-4387f059a380_h7exu880 Sep 30 19:51:41 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:41 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c" returned: 0 in 0.364s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:41 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa9edc20-3785-497c-bbbc-4387f059a380_h7exu880" returned: 1 in 0.365s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa9edc20-3785-497c-bbbc-4387f059a380_h7exu880' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:41 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c Sep 30 19:51:41 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aca175-0590-4fd6-8729-74c8f4d9b451]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:41 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD Sep 30 19:51:41 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:41 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-04d2e1dd-d747-4914-a9c9-29348a51f96c" returned: 0 in 0.250s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-04d2e1dd-d747-4914-a9c9-29348a51f96c" released by "delete_volume" :: held 0.658s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Created reservations ['635ccd78-82fc-40a3-9d49-9375f7bab99a', '23c84780-2356-4ab3-af82-19c598361992', '4afa16cb-bcd5-4021-8c38-427ce8aafcbd', '26896935-e0a4-4f9e-bcbf-2786771e34ee'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:41 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:41 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:41 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:41 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD Sep 30 19:51:41 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:42 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:42 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] fa9edc20-3785-497c-bbbc-4387f059a380 was raw, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.282s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Deleted volume successfully. Sep 30 19:51:42 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b Sep 30 19:51:42 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e8f492b3-ece1-4cca-8c14-15b76feb436b tempest-VolumesGetTest-748260309 None] Lock "cinder-04d2e1dd-d747-4914-a9c9-29348a51f96c-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (15fac115-844f-4a7d-b361-d66166ee262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3511a8e5-dc9f-4b98-85c9-6337a45de6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:42 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b" returned: 0 in 0.512s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa9edc20-3785-497c-bbbc-4387f059a380_asf4xpubdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:51:42 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3511a8e5-dc9f-4b98-85c9-6337a45de6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2134060956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b56095-8766-4c15-873f-7be1055ca05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:43Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:42 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b 1G Sep 30 19:51:42 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be13726c-8f67-4d47-b4f2-a764e7ded7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be13726c-8f67-4d47-b4f2-a764e7ded7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72331f3f-37ed-40cc-b880-b431231e1ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72331f3f-37ed-40cc-b880-b431231e1ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b56095-8766-4c15-873f-7be1055ca05b', 'volume_name': 'volume-b5b56095-8766-4c15-873f-7be1055ca05b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2e4c9b-6804-4839-b6c2-30a3a9927392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2e4c9b-6804-4839-b6c2-30a3a9927392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeec289c-3abc-4788-a103-868ecb9ed9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:42 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Volume b5b56095-8766-4c15-873f-7be1055ca05b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b56095-8766-4c15-873f-7be1055ca05b', 'volume_size': 1} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2134060956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b56095-8766-4c15-873f-7be1055ca05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:43Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Creating volume b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:51:42 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:42 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b 1073741824 Sep 30 19:51:42 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:42 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b 1G" returned: 0 in 0.333s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Downloaded image fa9edc20-3785-497c-bbbc-4387f059a380 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa9edc20-3785-497c-bbbc-4387f059a380', 'metadata': {}}])) to volume 1586656d-57fa-433b-ad19-1607ec73599b successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Temporary image fa9edc20-3785-497c-bbbc-4387f059a380 for user 566d6593f8064da19d45b0097d55b887 is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Marking volume 1586656d-57fa-433b-ad19-1607ec73599b as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Copying metadata from image fa9edc20-3785-497c-bbbc-4387f059a380 to 1586656d-57fa-433b-ad19-1607ec73599b. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:51:42 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Creating volume glance metadata for volume 1586656d-57fa-433b-ad19-1607ec73599b backed by image fa9edc20-3785-497c-bbbc-4387f059a380 with: {'image_id': 'fa9edc20-3785-497c-bbbc-4387f059a380', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '428cc8326e13fd0e4a332cfff9778256', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b8e998-f283-4e40-83eb-22fef4ab68e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1586656d-57fa-433b-ad19-1607ec73599b', 'volume_size': 1, 'image_id': 'fa9edc20-3785-497c-bbbc-4387f059a380', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa9edc20-3785-497c-bbbc-4387f059a380', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '428cc8326e13fd0e4a332cfff9778256', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55cb0c0d81f74155b08f7fca15d676e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '56c1baed3f4cad652f348e6d9b5b7c1497ecddb35aa66f31fc04d204f29a2b23376874ab1ad8828ea1ea532fd86f07ca6fc1a6ac468861801ede96c8c8c7531c', 'id': 'fa9edc20-3785-497c-bbbc-4387f059a380', 'created_at': datetime.datetime(2026, 9, 30, 17, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 51, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa9edc20-3785-497c-bbbc-4387f059a380/file', 'properties': {}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a867e87-e65b-439d-a20c-15c64ad4c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:43 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Volume volume-1586656d-57fa-433b-ad19-1607ec73599b (1586656d-57fa-433b-ad19-1607ec73599b): created successfully Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a867e87-e65b-439d-a20c-15c64ad4c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Flow 'volume_create_manager' (63822500-f69d-4764-b0ba-23172b36aa38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:43 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-50482a67-3ffd-4825-a541-3bf4e2d72324 tempest-VolumeImageDependencyTests-716021287 None] Created volume successfully. Sep 30 19:51:43 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b 1073741824" returned: 0 in 0.466s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:43 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b Sep 30 19:51:43 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:43 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b" returned: 0 in 0.255s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeec289c-3abc-4788-a103-868ecb9ed9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b56095-8766-4c15-873f-7be1055ca05b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339dd357-9e5f-464d-8256-36c9dd5797b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:43 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Volume volume-b5b56095-8766-4c15-873f-7be1055ca05b (b5b56095-8766-4c15-873f-7be1055ca05b): created successfully Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339dd357-9e5f-464d-8256-36c9dd5797b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (15fac115-844f-4a7d-b361-d66166ee262c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:43 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d1e0a3f9-1e8f-4446-b799-80bec1c8b26f tempest-VolumesGetTest-748260309 None] Created volume successfully. Sep 30 19:51:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Acquiring lock "cinder-1586656d-57fa-433b-ad19-1607ec73599b-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Lock "cinder-1586656d-57fa-433b-ad19-1607ec73599b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Acquiring lock "cinder-quobyte-1586656d-57fa-433b-ad19-1607ec73599b" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Lock "cinder-quobyte-1586656d-57fa-433b-ad19-1607ec73599b" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:44 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0a3b43-88f9-43a7-a916-94e8243b7fe1]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:44 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b Sep 30 19:51:44 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:44 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b" returned: 0 in 0.380s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:44 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b Sep 30 19:51:44 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:45 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1586656d-57fa-433b-ad19-1607ec73599b" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Lock "cinder-quobyte-1586656d-57fa-433b-ad19-1607ec73599b" released by "delete_volume" :: held 0.695s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Created reservations ['ea54be0f-ddf8-4780-b922-9a87c9e3f1fb', 'db1f69fd-b297-4870-aed0-de31310f3008', '0a1b7ca7-afd3-481a-8adb-225ca2b59d08', '9e0453a6-bec3-46e3-b9d5-3bb1eda14575'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (75306934-9967-477f-ad32-b2d9be866981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aa99cc-bb19-4f8a-9a3f-e86c591efdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aa99cc-bb19-4f8a-9a3f-e86c591efdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-526894467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d06f9e4-3d14-405d-8431-ab3be9a25c2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b5b56095-8766-4c15-873f-7be1055ca05b,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:45Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816af3e7-58c7-4fdc-a037-92159d8eee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816af3e7-58c7-4fdc-a037-92159d8eee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cdf969-0656-4c82-99d6-286c82774ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cdf969-0656-4c82-99d6-286c82774ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3d06f9e4-3d14-405d-8431-ab3be9a25c2f', 'volume_name': 'volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f', 'volume_size': 1, 'source_volid': 'b5b56095-8766-4c15-873f-7be1055ca05b', 'source_volstatus': 'available'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0f9681-23d6-423c-9f93-8a8c78d681ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0f9681-23d6-423c-9f93-8a8c78d681ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b601c8-f47b-4db4-9564-b5ed36ccaeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:45 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Volume 3d06f9e4-3d14-405d-8431-ab3be9a25c2f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f', 'volume_size': 1, 'source_volid': 'b5b56095-8766-4c15-873f-7be1055ca05b', 'source_volstatus': 'available'} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:45 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Cloning volume b5b56095-8766-4c15-873f-7be1055ca05b to volume 3d06f9e4-3d14-405d-8431-ab3be9a25c2f Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Creating offline snapshot 47925817-e2f6-4943-9bf0-232858e292e2 of volume b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:51:45 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:45 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a60868a-9dc3-4dee-bedb-13e29439e6a9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:45 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b Sep 30 19:51:45 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:45 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.274s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Deleted volume successfully. Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-67276f84-8d0a-4d23-a194-dd8ab8280990 tempest-VolumeImageDependencyTests-716021287 None] Lock "cinder-1586656d-57fa-433b-ad19-1607ec73599b-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:45 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b" returned: 0 in 0.425s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:45 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 1G Sep 30 19:51:45 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:46 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 1G" returned: 0 in 0.462s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5b56095-8766-4c15-873f-7be1055ca05b -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:46 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5b56095-8766-4c15-873f-7be1055ca05b -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 Sep 30 19:51:46 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:46 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5b56095-8766-4c15-873f-7be1055ca05b -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2" returned: 0 in 0.322s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:46 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 is being set with open permissions: ugo+rw Sep 30 19:51:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:46 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 Sep 30 19:51:46 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:46 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2" returned: 0 in 0.260s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:46 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.info Sep 30 19:51:46 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:47 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.info" returned: 0 in 0.283s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:47 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.info is being set with open permissions: ugo+rw Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:47 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.info Sep 30 19:51:47 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:47 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.info" returned: 0 in 0.267s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-quobyte-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] snapshot: 47925817-e2f6-4943-9bf0-232858e292e2, volume: 3d06f9e4-3d14-405d-8431-ab3be9a25c2f, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4a995c-6736-46db-8a18-d7ff51584abe]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:47 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 Sep 30 19:51:47 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:47 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2" returned: 0 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5b56095-8766-4c15-873f-7be1055ca05b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3f8bb-00d4-4449-bda6-59c54b4859de]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:47 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b Sep 30 19:51:47 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:48 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b" returned: 0 in 0.377s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:51:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:51:48 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:51:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:48 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f Sep 30 19:51:48 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:54 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" returned: 0 in 6.123s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:51:54 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Converted 1024.00 MB image at 167.20 MB/s Sep 30 19:51:54 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f is being set with open permissions: ugo+rw Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:54 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f Sep 30 19:51:54 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:54 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" returned: 0 in 0.245s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" released by "_copy_volume_from_snapshot" :: held 7.174s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-quobyte-47925817-e2f6-4943-9bf0-232858e292e2" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-47925817-e2f6-4943-9bf0-232858e292e2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Deleting offline snapshot 47925817-e2f6-4943-9bf0-232858e292e2 of volume b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] snapshot_file for this snap is: volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8eb277-68fb-4eef-be8a-7240bc5cf55d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:54 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 Sep 30 19:51:54 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:55 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2" returned: 0 in 0.354s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5b56095-8766-4c15-873f-7be1055ca05b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:51:55 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3fa8b6-e7b7-4ba2-b014-0db45ea49345]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:55 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b Sep 30 19:51:55 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:55 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b" returned: 0 in 0.560s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:55 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 Sep 30 19:51:55 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:55 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2" returned: 0 in 0.321s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:55 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2 Sep 30 19:51:55 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:56 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b.47925817-e2f6-4943-9bf0-232858e292e2" returned: 0 in 0.250s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-47925817-e2f6-4943-9bf0-232858e292e2" released by "_delete_snapshot" :: held 1.580s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.997s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b601c8-f47b-4db4-9564-b5ed36ccaeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f', 'volume_size': 1, 'source_volid': 'b5b56095-8766-4c15-873f-7be1055ca05b', 'source_volstatus': 'available'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab426d9-77c6-451d-86ff-850e84b599fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Volume volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f (3d06f9e4-3d14-405d-8431-ab3be9a25c2f): created successfully Sep 30 19:51:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab426d9-77c6-451d-86ff-850e84b599fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (75306934-9967-477f-ad32-b2d9be866981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-509b9f4b-7c83-4b65-be74-10cc0ac14f5a tempest-VolumesGetTest-748260309 None] Created volume successfully. Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (53321b6c-90ae-47c2-b3f7-c10287ca2fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c33b05-7be7-426b-a9a7-b74f968ce799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c33b05-7be7-426b-a9a7-b74f968ce799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1522767016',display_name='tempest-VolumesGetTest-Volume-1704240106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e549ae4-4f38-46c3-8b74-c0dd75c63379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:57Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a7e16c-52a6-4884-97de-b8bd94cd0ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a7e16c-52a6-4884-97de-b8bd94cd0ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539ed1b0-e947-4b4b-aae5-b6c9175a56b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539ed1b0-e947-4b4b-aae5-b6c9175a56b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e549ae4-4f38-46c3-8b74-c0dd75c63379', 'volume_name': 'volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ef80ec-1b14-4fff-abbd-a62e84844d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ef80ec-1b14-4fff-abbd-a62e84844d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1526683-7dfb-41bb-ad16-f08dfbb133e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Volume 1e549ae4-4f38-46c3-8b74-c0dd75c63379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379', 'volume_size': 1} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:51:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1522767016',display_name='tempest-VolumesGetTest-Volume-1704240106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e549ae4-4f38-46c3-8b74-c0dd75c63379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:51:57Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Creating volume 1e549ae4-4f38-46c3-8b74-c0dd75c63379 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:51:57 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:51:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:57 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 1073741824 Sep 30 19:51:57 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:58 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 1073741824" returned: 0 in 0.407s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:58 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 Sep 30 19:51:58 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:58 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379" returned: 0 in 0.239s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1526683-7dfb-41bb-ad16-f08dfbb133e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c004d1a-6fa8-4020-a11c-1b9a763507a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:51:58 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Volume volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 (1e549ae4-4f38-46c3-8b74-c0dd75c63379): created successfully Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c004d1a-6fa8-4020-a11c-1b9a763507a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (53321b6c-90ae-47c2-b3f7-c10287ca2fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:51:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-73845e66-e32b-4091-baed-5d9408b16f9b tempest-VolumesGetTest-748260309 None] Created volume successfully. Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-1e549ae4-4f38-46c3-8b74-c0dd75c63379-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Lock "cinder-1e549ae4-4f38-46c3-8b74-c0dd75c63379-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-quobyte-1e549ae4-4f38-46c3-8b74-c0dd75c63379" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-1e549ae4-4f38-46c3-8b74-c0dd75c63379" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e82fefc-687d-4c41-b482-c72506c9a6b6]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:58 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 Sep 30 19:51:58 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:59 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379" returned: 0 in 0.355s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:59 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379 Sep 30 19:51:59 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:59 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e549ae4-4f38-46c3-8b74-c0dd75c63379" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-1e549ae4-4f38-46c3-8b74-c0dd75c63379" released by "delete_volume" :: held 0.641s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Created reservations ['2507714e-0655-42dc-bea3-5a3a77c04c6e', '8b1e4b0e-b582-4fc9-abec-62b1d04c5e49', 'aab4aca4-43f9-448f-bb69-f9832844409d', 'ac1dcb54-ea2e-4f11-9fa1-3f2b159604cf'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:51:59 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:51:59 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:51:59 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.255s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:51:59 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Deleted volume successfully. Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fdd4f90d-8864-4ab9-a619-d4b062ef55ce tempest-VolumesGetTest-748260309 None] Lock "cinder-1e549ae4-4f38-46c3-8b74-c0dd75c63379-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-3d06f9e4-3d14-405d-8431-ab3be9a25c2f-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Lock "cinder-3d06f9e4-3d14-405d-8431-ab3be9a25c2f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-quobyte-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" acquired by "delete_volume" :: waited 0.012s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[314dccf4-36a8-4906-839d-521663e7752a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:51:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:00 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f Sep 30 19:52:00 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:00 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" returned: 0 in 0.363s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:00 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f Sep 30 19:52:00 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:00 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" returned: 0 in 0.244s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-3d06f9e4-3d14-405d-8431-ab3be9a25c2f" released by "delete_volume" :: held 0.647s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Created reservations ['94a87c57-d077-4f18-9294-90e1a56be6ef', 'ce5688d8-feae-493e-affe-0549cd227c47', 'a25126ed-5517-439b-9a79-f4fbdeecfe8d', '1b2e273d-380b-4940-99fa-7fc324321027'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:00 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:52:00 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:00 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.247s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:00 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:52:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Deleted volume successfully. Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7588086e-7c52-44ef-b596-cba2b1b116d9 tempest-VolumesGetTest-748260309 None] Lock "cinder-3d06f9e4-3d14-405d-8431-ab3be9a25c2f-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-b5b56095-8766-4c15-873f-7be1055ca05b-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Lock "cinder-b5b56095-8766-4c15-873f-7be1055ca05b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-quobyte-b5b56095-8766-4c15-873f-7be1055ca05b" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-b5b56095-8766-4c15-873f-7be1055ca05b" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2cd662-041e-492b-80b8-ab34b7af1539]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:01 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b Sep 30 19:52:01 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:01 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b" returned: 0 in 0.354s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:01 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b Sep 30 19:52:01 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:01 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b5b56095-8766-4c15-873f-7be1055ca05b" returned: 0 in 0.245s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-b5b56095-8766-4c15-873f-7be1055ca05b" released by "delete_volume" :: held 0.663s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Created reservations ['cc528f4a-9448-40ad-b5d9-395475ff3f32', '546d52c6-3e9e-4f89-9478-a280a1183470', '266fa8ea-c465-4376-a1b7-3e4df558f461', 'bc360335-6f30-4581-9a9e-0d95573a37c2'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:01 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:52:01 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:02 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.246s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:52:02 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Deleted volume successfully. Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d2342942-d16f-4f81-b531-1c4ec8e1e80b tempest-VolumesGetTest-748260309 None] Lock "cinder-b5b56095-8766-4c15-873f-7be1055ca05b-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (7d845749-85c3-48e0-a19d-3b625e5d2830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e905e356-57b6-4f3f-bb31-a7b5668e9023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e905e356-57b6-4f3f-bb31-a7b5668e9023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-304199221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a703d7-e37b-40ae-a4b7-6803876b10ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:03Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b025b0a8-7469-47fb-965c-fb987d363d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b025b0a8-7469-47fb-965c-fb987d363d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90447745-1dce-459b-80ad-643eafcef836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:02 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90447745-1dce-459b-80ad-643eafcef836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33a703d7-e37b-40ae-a4b7-6803876b10ec', 'volume_name': 'volume-33a703d7-e37b-40ae-a4b7-6803876b10ec', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701d6f91-7c8c-48b1-9117-c2f18153c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701d6f91-7c8c-48b1-9117-c2f18153c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db538df2-db0e-4c3b-b181-29e73809fcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:03 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Volume 33a703d7-e37b-40ae-a4b7-6803876b10ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33a703d7-e37b-40ae-a4b7-6803876b10ec', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Trying to clone 33a703d7-e37b-40ae-a4b7-6803876b10ec from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b at location (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:52:03 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Image download 20.69 MB at 20.69 MB/s Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dac276-0c3d-415c-9665-824adf684a30]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:03 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD Sep 30 19:52:03 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:03 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:03 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b is fetched for user 5a7ce361b79e42759808432512c750fe. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdf7d56-0860-4606-8158-186dd8e48c4d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:04 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD Sep 30 19:52:04 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:04 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-304199221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a703d7-e37b-40ae-a4b7-6803876b10ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:03Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Creating volume 33a703d7-e37b-40ae-a4b7-6803876b10ec {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:52:04 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:04 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec 1073741824 Sep 30 19:52:04 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:04 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec 1073741824" returned: 0 in 0.417s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:04 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec Sep 30 19:52:04 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:05 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Attempting download of 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume 33a703d7-e37b-40ae-a4b7-6803876b10ec. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ce501-f7fd-4f56-b2d0-b49f6c3e3db9]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_jnuhwywd {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:05 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_jnuhwywd Sep 30 19:52:05 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:05 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_jnuhwywd" returned: 0 in 0.328s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_jnuhwywd {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:05 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_jnuhwywd Sep 30 19:52:05 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:05 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_jnuhwywd" returned: 1 in 0.320s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5be8283e-b86b-4bc8-8baa-e16813f20b2b_jnuhwywd' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[051226d9-65c4-4755-888f-f2c5217be8b9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:05 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD Sep 30 19:52:05 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:06 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:06 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] 5be8283e-b86b-4bc8-8baa-e16813f20b2b was qcow2, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:52:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:06 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec Sep 30 19:52:06 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:07 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec" returned: 0 in 1.694s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:07 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5be8283e-b86b-4bc8-8baa-e16813f20b2b_6h4c2wv2devstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:52:07 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Converted 112.00 MB image at 66.08 MB/s Sep 30 19:52:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:07 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec 1G Sep 30 19:52:07 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:08 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec 1G" returned: 0 in 0.315s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Downloaded image 5be8283e-b86b-4bc8-8baa-e16813f20b2b ((None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}])) to volume 33a703d7-e37b-40ae-a4b7-6803876b10ec successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Temporary image 5be8283e-b86b-4bc8-8baa-e16813f20b2b for user 5a7ce361b79e42759808432512c750fe is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Marking volume 33a703d7-e37b-40ae-a4b7-6803876b10ec as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Copying metadata from image 5be8283e-b86b-4bc8-8baa-e16813f20b2b to 33a703d7-e37b-40ae-a4b7-6803876b10ec. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Creating volume glance metadata for volume 33a703d7-e37b-40ae-a4b7-6803876b10ec backed by image 5be8283e-b86b-4bc8-8baa-e16813f20b2b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:INSERT=43,cinder:UPDATE=144,cinder:SELECT=109,cinder:DELETE=11 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db538df2-db0e-4c3b-b181-29e73809fcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a703d7-e37b-40ae-a4b7-6803876b10ec', 'volume_size': 1, 'image_id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb597adb2cae431b80a965cb1d445a55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5be8283e-b86b-4bc8-8baa-e16813f20b2b', 'created_at': datetime.datetime(2026, 9, 30, 17, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5be8283e-b86b-4bc8-8baa-e16813f20b2b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab01de55-d0eb-4c42-92ab-baf68bbdcdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:08 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Volume volume-33a703d7-e37b-40ae-a4b7-6803876b10ec (33a703d7-e37b-40ae-a4b7-6803876b10ec): created successfully Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab01de55-d0eb-4c42-92ab-baf68bbdcdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:08 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (7d845749-85c3-48e0-a19d-3b625e5d2830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:08 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-511828b7-9b2a-46cc-b84e-4a9ed1df5066 tempest-VolumesGetTest-748260309 None] Created volume successfully. Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (c7255621-70fb-4a30-ae31-34058276529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52716359-0a56-4fb4-8d5f-fca88c8b3126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52716359-0a56-4fb4-8d5f-fca88c8b3126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-930602419',display_name='tempest-VolumesGetTest-Volume-176149256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d241d46b-f108-46f9-a620-58136120b42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:10Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d65036-5532-437a-b77d-5b36170f087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d65036-5532-437a-b77d-5b36170f087c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a5e676-3330-4262-b01f-a0b89988d193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a5e676-3330-4262-b01f-a0b89988d193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd241d46b-f108-46f9-a620-58136120b42f', 'volume_name': 'volume-d241d46b-f108-46f9-a620-58136120b42f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380af955-afdf-4a70-915b-182432a671c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380af955-afdf-4a70-915b-182432a671c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7e93c0-e611-488c-bb6e-d103ff22d578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:09 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Volume d241d46b-f108-46f9-a620-58136120b42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d241d46b-f108-46f9-a620-58136120b42f', 'volume_size': 1} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-930602419',display_name='tempest-VolumesGetTest-Volume-176149256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d241d46b-f108-46f9-a620-58136120b42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74f361cb0e4461bf240c66e05b2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:10Z,use_quota=True,user_id='5a7ce361b79e42759808432512c750fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Creating volume d241d46b-f108-46f9-a620-58136120b42f {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:52:09 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:52:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:10 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f 1073741824 Sep 30 19:52:10 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:10 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f 1073741824" returned: 0 in 0.422s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:10 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f Sep 30 19:52:10 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:10 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f" returned: 0 in 0.242s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:10 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:52:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:10 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7e93c0-e611-488c-bb6e-d103ff22d578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d241d46b-f108-46f9-a620-58136120b42f', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:10 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40760319-85f0-44f7-ba27-dbe9255dad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:10 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Volume volume-d241d46b-f108-46f9-a620-58136120b42f (d241d46b-f108-46f9-a620-58136120b42f): created successfully Sep 30 19:52:10 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40760319-85f0-44f7-ba27-dbe9255dad4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:10 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Flow 'volume_create_manager' (c7255621-70fb-4a30-ae31-34058276529c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:10 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1da77925-3114-48c1-9f5f-388be5442ac6 tempest-VolumesGetTest-748260309 None] Created volume successfully. Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-d241d46b-f108-46f9-a620-58136120b42f-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Lock "cinder-d241d46b-f108-46f9-a620-58136120b42f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-quobyte-d241d46b-f108-46f9-a620-58136120b42f" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-d241d46b-f108-46f9-a620-58136120b42f" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[207df0c3-d435-4a1e-997e-75850281be27]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:11 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f Sep 30 19:52:11 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:11 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f" returned: 0 in 0.364s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:11 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f Sep 30 19:52:11 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:11 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d241d46b-f108-46f9-a620-58136120b42f" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-d241d46b-f108-46f9-a620-58136120b42f" released by "delete_volume" :: held 0.646s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Created reservations ['36ac5081-9e28-46b3-81dc-13f176f78e50', '50bd9b16-3fbe-4dd0-a1cd-4e8d80923330', 'c1c608a7-5ae7-4755-88a4-13140f8f21be', 'e0f1130c-fb2d-443f-9d73-6828e6c2280e'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:11 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:52:11 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:12 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.255s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:52:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Deleted volume successfully. Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-44f52dd3-5efc-45d8-a692-924be8182146 tempest-VolumesGetTest-748260309 None] Lock "cinder-d241d46b-f108-46f9-a620-58136120b42f-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-33a703d7-e37b-40ae-a4b7-6803876b10ec-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Lock "cinder-33a703d7-e37b-40ae-a4b7-6803876b10ec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Acquiring lock "cinder-quobyte-33a703d7-e37b-40ae-a4b7-6803876b10ec" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-33a703d7-e37b-40ae-a4b7-6803876b10ec" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3552d6-2251-4bd4-975e-75bd0fe0b8be]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:12 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec Sep 30 19:52:12 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:12 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec" returned: 0 in 0.365s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:12 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec Sep 30 19:52:12 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:12 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-33a703d7-e37b-40ae-a4b7-6803876b10ec" returned: 0 in 0.249s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Lock "cinder-quobyte-33a703d7-e37b-40ae-a4b7-6803876b10ec" released by "delete_volume" :: held 0.654s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Created reservations ['05f9ee59-6234-425b-bb81-c454b2b63b3f', 'a43e6ac4-b6c1-4b06-9d08-787414270c4a', '1aa48b1f-5495-4817-aa8f-7b21bc2a307e', '75d7da4d-f87e-4bea-b266-dbfbb5c1c830'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:13 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:52:13 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:13 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.255s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:52:13 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Deleted volume successfully. Sep 30 19:52:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-15411957-03da-4588-a164-8895d103babc tempest-VolumesGetTest-748260309 None] Lock "cinder-33a703d7-e37b-40ae-a4b7-6803876b10ec-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:23 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=80,cinder:INSERT=34,cinder:UPDATE=80,cinder:DELETE=6 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:52:23 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=11,cinder:INSERT=10,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:52:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:52:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:23 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:52:23 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:24 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.263s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:52:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:52:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:52:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (f52fd3ad-b634-47c7-97a0-82d38ad212b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630e2c46-b80d-4c88-b254-f345931a31d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630e2c46-b80d-4c88-b254-f345931a31d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-624648710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a26fec-bb1f-4380-9e4c-6e08da609c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e707e69b74ec2b178e19ee9037ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:25Z,use_quota=True,user_id='85797f4414da462ab29add1407a11b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebc15b0-a757-40d1-bcc0-862685d636a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebc15b0-a757-40d1-bcc0-862685d636a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9b721f-4532-4788-9055-c84cd46e3760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9b721f-4532-4788-9055-c84cd46e3760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a26fec-bb1f-4380-9e4c-6e08da609c42', 'volume_name': 'volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821ee6c5-1edc-4eb5-8353-011e71254307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821ee6c5-1edc-4eb5-8353-011e71254307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad527e80-4614-4b3c-9803-3ffd2409a86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:25 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume e5a26fec-bb1f-4380-9e4c-6e08da609c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42', 'volume_size': 1} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-624648710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a26fec-bb1f-4380-9e4c-6e08da609c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e707e69b74ec2b178e19ee9037ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:25Z,use_quota=True,user_id='85797f4414da462ab29add1407a11b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Creating volume e5a26fec-bb1f-4380-9e4c-6e08da609c42 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:52:25 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:25 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 1073741824 Sep 30 19:52:25 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:25 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 1073741824" returned: 0 in 0.413s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:25 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 Sep 30 19:52:25 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:26 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad527e80-4614-4b3c-9803-3ffd2409a86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7557aa-457f-4be4-858a-22f7dcce557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:26 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 (e5a26fec-bb1f-4380-9e4c-6e08da609c42): created successfully Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7557aa-457f-4be4-858a-22f7dcce557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (f52fd3ad-b634-47c7-97a0-82d38ad212b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:26 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f3ebb367-a9a5-40af-a018-7bc621ba6e65 tempest-VolumesSnapshotTestJSON-1645704205 None] Created volume successfully. Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Creating offline snapshot 7f026698-d9e5-43c6-be64-40272bf7b44d of volume e5a26fec-bb1f-4380-9e4c-6e08da609c42 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f47564-5122-46b3-9840-327c9c678ed2]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:26 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 Sep 30 19:52:26 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:26 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42" returned: 0 in 0.357s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:27 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d 1G Sep 30 19:52:27 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:27 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d 1G" returned: 0 in 0.391s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:27 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d Sep 30 19:52:27 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:27 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d" returned: 0 in 0.290s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:27 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d is being set with open permissions: ugo+rw Sep 30 19:52:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:27 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d Sep 30 19:52:27 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:27 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d" returned: 0 in 0.237s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:27 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.info Sep 30 19:52:27 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:28 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.info" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:28 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.info is being set with open permissions: ugo+rw Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:28 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.info Sep 30 19:52:28 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:28 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.info" returned: 0 in 0.244s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2c3221e4-0a90-46a5-a17b-84b5fa2f27fd tempest-VolumesSnapshotTestJSON-1645704205 None] Create snapshot completed successfully Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-7f026698-d9e5-43c6-be64-40272bf7b44d-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-7f026698-d9e5-43c6-be64-40272bf7b44d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-e5a26fec-bb1f-4380-9e4c-6e08da609c42" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-e5a26fec-bb1f-4380-9e4c-6e08da609c42" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-7f026698-d9e5-43c6-be64-40272bf7b44d" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-7f026698-d9e5-43c6-be64-40272bf7b44d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Deleting offline snapshot 7f026698-d9e5-43c6-be64-40272bf7b44d of volume e5a26fec-bb1f-4380-9e4c-6e08da609c42 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] snapshot_file for this snap is: volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[78531e2e-34b3-4beb-9bbb-cacf30138980]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:29 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d Sep 30 19:52:29 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:29 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d" returned: 0 in 0.355s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:52:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[93defbe3-f891-4aca-af48-7456bfc03616]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:29 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 Sep 30 19:52:29 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:29 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42" returned: 0 in 0.352s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:29 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d Sep 30 19:52:29 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:30 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d" returned: 0 in 0.328s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:30 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d Sep 30 19:52:30 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:30 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42.7f026698-d9e5-43c6-be64-40272bf7b44d" returned: 0 in 0.244s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-7f026698-d9e5-43c6-be64-40272bf7b44d" released by "_delete_snapshot" :: held 1.381s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-e5a26fec-bb1f-4380-9e4c-6e08da609c42" released by "delete_snapshot" :: held 1.401s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Created reservations ['50eade2d-024f-4d52-b338-210668f7005f', '0f543902-ddbb-45a1-99b0-2c399dea1c8a', 'f9794b3d-5694-47fd-b670-2545ca1a4ffb', '11a45e43-b026-4195-9092-68eaf4029b63'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:52:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Delete snapshot completed successfully. Sep 30 19:52:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-20017a8a-712b-4de5-a696-2d669b65cf2b tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-7f026698-d9e5-43c6-be64-40272bf7b44d-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (90ddb60a-8eb4-4887-b56c-af24751dfc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0633b8-bdc9-4e0e-9609-f496e7c2025a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0633b8-bdc9-4e0e-9609-f496e7c2025a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1051177181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec59d281-528f-4951-ace6-4d9e26cafdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e707e69b74ec2b178e19ee9037ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:31Z,use_quota=True,user_id='85797f4414da462ab29add1407a11b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4093c3f2-9ca3-43bd-bdb2-f39c7538e3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4093c3f2-9ca3-43bd-bdb2-f39c7538e3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb90b617-f822-4751-8e4f-dabdabd2a1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb90b617-f822-4751-8e4f-dabdabd2a1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec59d281-528f-4951-ace6-4d9e26cafdb5', 'volume_name': 'volume-ec59d281-528f-4951-ace6-4d9e26cafdb5', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38f729c-fe39-4b31-bb80-67072131a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38f729c-fe39-4b31-bb80-67072131a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92157fdd-e473-49c6-b9d9-368f7053c7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:31 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Volume ec59d281-528f-4951-ace6-4d9e26cafdb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec59d281-528f-4951-ace6-4d9e26cafdb5', 'volume_size': 1} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1051177181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec59d281-528f-4951-ace6-4d9e26cafdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e707e69b74ec2b178e19ee9037ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:31Z,use_quota=True,user_id='85797f4414da462ab29add1407a11b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Creating volume ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:52:31 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:31 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 1073741824 Sep 30 19:52:31 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:31 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 1073741824" returned: 0 in 0.404s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:32 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 Sep 30 19:52:32 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:32 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5" returned: 0 in 0.251s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92157fdd-e473-49c6-b9d9-368f7053c7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec59d281-528f-4951-ace6-4d9e26cafdb5', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de194a4-fe70-431e-9e48-3851de6f552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:32 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Volume volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 (ec59d281-528f-4951-ace6-4d9e26cafdb5): created successfully Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de194a4-fe70-431e-9e48-3851de6f552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (90ddb60a-8eb4-4887-b56c-af24751dfc32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:32 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0e015cba-c9ea-4346-b029-0596577c802f tempest-VolumesSnapshotTestJSON-1645704205 None] Created volume successfully. Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Creating offline snapshot 8b700660-adcd-40d9-9a37-e074f14ce0d1 of volume ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee234c0-44fd-48c4-a68b-893535e78b2e]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:32 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 Sep 30 19:52:32 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:33 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5" returned: 0 in 0.361s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:33 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 1G Sep 30 19:52:33 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:33 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 1G" returned: 0 in 0.385s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:33 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 Sep 30 19:52:33 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:33 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1" returned: 0 in 0.290s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:33 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 is being set with open permissions: ugo+rw Sep 30 19:52:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:33 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 Sep 30 19:52:33 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:33 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:34 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.info Sep 30 19:52:34 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:34 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.info" returned: 0 in 0.249s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:34 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.info is being set with open permissions: ugo+rw Sep 30 19:52:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:34 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.info Sep 30 19:52:34 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:34 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.info" returned: 0 in 0.247s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:34 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ecdda92d-8704-4586-b227-dbabe85e7ee2 tempest-VolumesSnapshotTestJSON-1645704205 None] Create snapshot completed successfully Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (f1be9569-0d71-4fb8-be5c-c9c991b9f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a9f007-d747-4956-ac71-96294e2bedd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a9f007-d747-4956-ac71-96294e2bedd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1932347642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccc252d-f04b-47a0-88f9-72bc27875dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e707e69b74ec2b178e19ee9037ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8b700660-adcd-40d9-9a37-e074f14ce0d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:35Z,use_quota=True,user_id='85797f4414da462ab29add1407a11b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f530f8-f5c3-4085-81cb-1407adfb953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f530f8-f5c3-4085-81cb-1407adfb953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb05d0ee-8c3e-4f91-8e3c-e3d81ed5ec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb05d0ee-8c3e-4f91-8e3c-e3d81ed5ec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fccc252d-f04b-47a0-88f9-72bc27875dc1', 'volume_name': 'volume-fccc252d-f04b-47a0-88f9-72bc27875dc1', 'volume_size': 2, 'snapshot_id': '8b700660-adcd-40d9-9a37-e074f14ce0d1'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70fb3eb-1272-4110-927c-14319e88f55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70fb3eb-1272-4110-927c-14319e88f55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6f9396-d518-445c-883b-da692b81a839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:35 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume fccc252d-f04b-47a0-88f9-72bc27875dc1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fccc252d-f04b-47a0-88f9-72bc27875dc1', 'volume_size': 2, 'snapshot_id': '8b700660-adcd-40d9-9a37-e074f14ce0d1'} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-8b700660-adcd-40d9-9a37-e074f14ce0d1-fccc252d-f04b-47a0-88f9-72bc27875dc1" by "_create_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-8b700660-adcd-40d9-9a37-e074f14ce0d1-fccc252d-f04b-47a0-88f9-72bc27875dc1" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Creating volume fccc252d-f04b-47a0-88f9-72bc27875dc1 from snapshot 8b700660-adcd-40d9-9a37-e074f14ce0d1 {{(pid=87426) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-fccc252d-f04b-47a0-88f9-72bc27875dc1" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-fccc252d-f04b-47a0-88f9-72bc27875dc1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] snapshot: 8b700660-adcd-40d9-9a37-e074f14ce0d1, volume: fccc252d-f04b-47a0-88f9-72bc27875dc1, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[541bb603-3e6a-496d-8beb-9916f64806f6]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:35 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 Sep 30 19:52:35 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:35 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1" returned: 0 in 0.360s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec59d281-528f-4951-ace6-4d9e26cafdb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bb721d-3195-4d58-9214-e348b026049b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:35 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 Sep 30 19:52:35 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:36 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5" returned: 0 in 0.361s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:52:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:52:36 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:52:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:36 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 Sep 30 19:52:36 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:42 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1" returned: 0 in 6.098s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:52:42 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Converted 1024.00 MB image at 167.88 MB/s Sep 30 19:52:42 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 is being set with open permissions: ugo+rw Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:42 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 Sep 30 19:52:42 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:42 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1" returned: 0 in 0.245s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-fccc252d-f04b-47a0-88f9-72bc27875dc1" released by "_copy_volume_from_snapshot" :: held 7.147s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-8b700660-adcd-40d9-9a37-e074f14ce0d1-fccc252d-f04b-47a0-88f9-72bc27875dc1" released by "_create_volume_from_snapshot" :: held 7.209s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.226s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6f9396-d518-445c-883b-da692b81a839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccc252d-f04b-47a0-88f9-72bc27875dc1', 'volume_size': 2, 'snapshot_id': '8b700660-adcd-40d9-9a37-e074f14ce0d1'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f489732-f5be-4f73-8a13-7a398ab6a8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:42 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 (fccc252d-f04b-47a0-88f9-72bc27875dc1): created successfully Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f489732-f5be-4f73-8a13-7a398ab6a8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (f1be9569-0d71-4fb8-be5c-c9c991b9f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ef6552b1-2fd1-4d69-b8c1-c92913a49c14 tempest-VolumesSnapshotTestJSON-1645704205 None] Created volume successfully. Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-fccc252d-f04b-47a0-88f9-72bc27875dc1-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-fccc252d-f04b-47a0-88f9-72bc27875dc1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-fccc252d-f04b-47a0-88f9-72bc27875dc1" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-fccc252d-f04b-47a0-88f9-72bc27875dc1" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6f2ff-5dac-4c7e-9e83-6c47a932015e]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:43 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 Sep 30 19:52:43 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:43 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1" returned: 0 in 0.354s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:43 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1 Sep 30 19:52:43 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:43 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-fccc252d-f04b-47a0-88f9-72bc27875dc1" returned: 0 in 0.242s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-fccc252d-f04b-47a0-88f9-72bc27875dc1" released by "delete_volume" :: held 0.636s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Created reservations ['e3fa75d1-a85d-4133-8daa-8556373d081e', '52c5b903-2495-4ec7-bfc9-7be735b8d0a5', 'd73827d6-6c53-409d-9ef6-b4aad786d392', 'b1c94150-40c3-4d2b-a67a-1f3bc7f8f470'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:43 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:52:43 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:44 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:52:44 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Deleted volume successfully. Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-026d30b6-4485-4fb8-bc65-878fe16ef2ce tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-fccc252d-f04b-47a0-88f9-72bc27875dc1-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-8b700660-adcd-40d9-9a37-e074f14ce0d1-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-8b700660-adcd-40d9-9a37-e074f14ce0d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-ec59d281-528f-4951-ace6-4d9e26cafdb5" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-ec59d281-528f-4951-ace6-4d9e26cafdb5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-8b700660-adcd-40d9-9a37-e074f14ce0d1" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-8b700660-adcd-40d9-9a37-e074f14ce0d1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Deleting offline snapshot 8b700660-adcd-40d9-9a37-e074f14ce0d1 of volume ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] snapshot_file for this snap is: volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56947dd3-8615-4983-92f9-66ce15d3e977]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:44 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 Sep 30 19:52:44 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:44 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1" returned: 0 in 0.367s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec59d281-528f-4951-ace6-4d9e26cafdb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[312aad3f-ce12-4544-bb3c-b72b1416e3fc]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:44 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 Sep 30 19:52:44 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:45 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5" returned: 0 in 0.549s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:45 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 Sep 30 19:52:45 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:45 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1" returned: 0 in 0.323s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:45 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1 Sep 30 19:52:45 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:45 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5.8b700660-adcd-40d9-9a37-e074f14ce0d1" returned: 0 in 0.238s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-8b700660-adcd-40d9-9a37-e074f14ce0d1" released by "_delete_snapshot" :: held 1.578s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-ec59d281-528f-4951-ace6-4d9e26cafdb5" released by "delete_snapshot" :: held 1.598s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:45 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Created reservations ['d3b1f58c-09c8-459d-8edd-44492c7b380c', '1a5513e3-f9f8-401a-b986-c5cc2b5810ee', '47f58ac7-47fe-4651-bcea-5d33eeffd4a3', '4d8a06ac-4c0d-4357-8448-d5f753fe7e3b'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:52:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Delete snapshot completed successfully. Sep 30 19:52:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7ee708d4-f932-461e-a301-4a5d6ca8f739 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-8b700660-adcd-40d9-9a37-e074f14ce0d1-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-ec59d281-528f-4951-ace6-4d9e26cafdb5-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-ec59d281-528f-4951-ace6-4d9e26cafdb5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-ec59d281-528f-4951-ace6-4d9e26cafdb5" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-ec59d281-528f-4951-ace6-4d9e26cafdb5" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aa89ca-2f6b-4ce5-8d1f-1831533820af]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:46 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 Sep 30 19:52:46 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:46 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5" returned: 0 in 0.350s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:46 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5 Sep 30 19:52:46 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:47 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ec59d281-528f-4951-ace6-4d9e26cafdb5" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-ec59d281-528f-4951-ace6-4d9e26cafdb5" released by "delete_volume" :: held 0.652s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Created reservations ['cdef6efe-7437-40f0-8b4a-77b39cee2c0e', '65744395-1989-4bed-b282-7765b38b0478', '0acfdfdf-c944-4ff1-a916-83c429faa48e', 'dfc2f6c6-73f9-4f3d-93dc-64c5ed3666d6'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:47 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:52:47 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:47 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:52:47 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Deleted volume successfully. Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a679b032-a34c-4606-ad15-118d55a31baa tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-ec59d281-528f-4951-ace6-4d9e26cafdb5-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (6c589d65-1a8d-46f7-8d03-ab0f035cdb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ba2bf3-f5b0-4d3a-a8e7-d295d5607597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ba2bf3-f5b0-4d3a-a8e7-d295d5607597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-740361043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5553a7-6b32-4f23-9c81-dd3b4668f3cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e707e69b74ec2b178e19ee9037ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:48Z,use_quota=True,user_id='85797f4414da462ab29add1407a11b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128b9e06-abdb-4235-939c-08dc96335891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128b9e06-abdb-4235-939c-08dc96335891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613b166f-5f50-469e-b743-f9c4cde324ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613b166f-5f50-469e-b743-f9c4cde324ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5553a7-6b32-4f23-9c81-dd3b4668f3cb', 'volume_name': 'volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d03d51-7c08-4e0e-812a-40b867e27157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d03d51-7c08-4e0e-812a-40b867e27157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0bd7a8-5b4d-4778-80a9-e33e44edee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:48 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume 1e5553a7-6b32-4f23-9c81-dd3b4668f3cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb', 'volume_size': 1} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-740361043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5553a7-6b32-4f23-9c81-dd3b4668f3cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e707e69b74ec2b178e19ee9037ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:48Z,use_quota=True,user_id='85797f4414da462ab29add1407a11b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Creating volume 1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:52:48 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:48 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb 1073741824 Sep 30 19:52:48 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:48 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb 1073741824" returned: 0 in 0.413s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:48 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb Sep 30 19:52:48 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:48 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" returned: 0 in 0.251s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0bd7a8-5b4d-4778-80a9-e33e44edee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a6fc26-b783-41d2-85ea-734d35aed2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:48 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb (1e5553a7-6b32-4f23-9c81-dd3b4668f3cb): created successfully Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a6fc26-b783-41d2-85ea-734d35aed2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (6c589d65-1a8d-46f7-8d03-ab0f035cdb85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fa21ce82-26a0-4ae3-8768-b581b3393576 tempest-VolumesSnapshotTestJSON-1645704205 None] Created volume successfully. Sep 30 19:52:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Creating offline snapshot 06d652a7-c162-417f-9e13-d0c3d4d1ccf8 of volume 1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:52:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[785ffff8-e13d-4685-b09c-20a8eca42eef]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:49 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb Sep 30 19:52:49 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:49 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" returned: 0 in 0.356s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:49 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 1G Sep 30 19:52:49 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:49 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 1G" returned: 0 in 0.385s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:49 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 Sep 30 19:52:49 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:50 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:50 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 is being set with open permissions: ugo+rw Sep 30 19:52:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:50 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 Sep 30 19:52:50 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:50 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8" returned: 0 in 0.244s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:50 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.info Sep 30 19:52:50 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:50 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.info" returned: 0 in 0.246s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:50 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.info is being set with open permissions: ugo+rw Sep 30 19:52:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:50 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.info Sep 30 19:52:50 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:50 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.info" returned: 0 in 0.238s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:51 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1e9f03df-92fa-4b3b-9a6c-c150e915afb9 tempest-VolumesSnapshotTestJSON-1645704205 None] Create snapshot completed successfully Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (ae9beb23-df93-4ac5-8625-17d9a704021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab9542e-9459-409a-bdd7-c21791ee049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab9542e-9459-409a-bdd7-c21791ee049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1006344243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a955ce-f112-44d3-8046-1ed3169c4593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='565e707e69b74ec2b178e19ee9037ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06d652a7-c162-417f-9e13-d0c3d4d1ccf8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:52:52Z,use_quota=True,user_id='85797f4414da462ab29add1407a11b63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774e4a93-d087-4746-ba97-f4f3a5e74417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774e4a93-d087-4746-ba97-f4f3a5e74417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5baa2fc-30d2-4de0-9632-19043bc0bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5baa2fc-30d2-4de0-9632-19043bc0bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83a955ce-f112-44d3-8046-1ed3169c4593', 'volume_name': 'volume-83a955ce-f112-44d3-8046-1ed3169c4593', 'volume_size': 1, 'snapshot_id': '06d652a7-c162-417f-9e13-d0c3d4d1ccf8'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f41e67-d9a5-4cc9-8f12-19313ffc444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f41e67-d9a5-4cc9-8f12-19313ffc444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482fb589-1f2f-4dd4-ac7b-72b311a91ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:51 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume 83a955ce-f112-44d3-8046-1ed3169c4593: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83a955ce-f112-44d3-8046-1ed3169c4593', 'volume_size': 1, 'snapshot_id': '06d652a7-c162-417f-9e13-d0c3d4d1ccf8'} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-06d652a7-c162-417f-9e13-d0c3d4d1ccf8-83a955ce-f112-44d3-8046-1ed3169c4593" by "_create_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-06d652a7-c162-417f-9e13-d0c3d4d1ccf8-83a955ce-f112-44d3-8046-1ed3169c4593" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Creating volume 83a955ce-f112-44d3-8046-1ed3169c4593 from snapshot 06d652a7-c162-417f-9e13-d0c3d4d1ccf8 {{(pid=87426) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-83a955ce-f112-44d3-8046-1ed3169c4593" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-83a955ce-f112-44d3-8046-1ed3169c4593" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] snapshot: 06d652a7-c162-417f-9e13-d0c3d4d1ccf8, volume: 83a955ce-f112-44d3-8046-1ed3169c4593, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a5fa14-33dd-4e9b-b0ce-2b8c71724a81]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:52 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 Sep 30 19:52:52 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:52 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8" returned: 0 in 0.363s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:52:52 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fea563-adda-42bf-b637-df3eae27e323]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:52 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb Sep 30 19:52:52 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:52 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" returned: 0 in 0.359s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:52:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:52:52 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:52:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:52 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 Sep 30 19:52:52 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:58 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593" returned: 0 in 5.939s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:52:58 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Converted 1024.00 MB image at 172.37 MB/s Sep 30 19:52:58 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 is being set with open permissions: ugo+rw Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:58 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 Sep 30 19:52:58 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:58 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-83a955ce-f112-44d3-8046-1ed3169c4593" released by "_copy_volume_from_snapshot" :: held 6.983s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-06d652a7-c162-417f-9e13-d0c3d4d1ccf8-83a955ce-f112-44d3-8046-1ed3169c4593" released by "_create_volume_from_snapshot" :: held 7.044s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.059s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482fb589-1f2f-4dd4-ac7b-72b311a91ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a955ce-f112-44d3-8046-1ed3169c4593', 'volume_size': 1, 'snapshot_id': '06d652a7-c162-417f-9e13-d0c3d4d1ccf8'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6664469a-ee18-4b6a-982b-8c09379244e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:52:58 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Volume volume-83a955ce-f112-44d3-8046-1ed3169c4593 (83a955ce-f112-44d3-8046-1ed3169c4593): created successfully Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6664469a-ee18-4b6a-982b-8c09379244e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:52:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Flow 'volume_create_manager' (ae9beb23-df93-4ac5-8625-17d9a704021b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:52:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fc7a9963-9b65-4e13-b01f-aed2b093e510 tempest-VolumesSnapshotTestJSON-1645704205 None] Created volume successfully. Sep 30 19:52:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-83a955ce-f112-44d3-8046-1ed3169c4593-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-83a955ce-f112-44d3-8046-1ed3169c4593-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-83a955ce-f112-44d3-8046-1ed3169c4593" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:52:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-83a955ce-f112-44d3-8046-1ed3169c4593" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:52:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51738f1-15c5-40fc-84cb-0a3e209c91c0]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:52:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:59 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 Sep 30 19:52:59 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:52:59 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 30 19:52:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593" returned: 0 in 0.343s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:52:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:52:59 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593 Sep 30 19:52:59 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:00 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-83a955ce-f112-44d3-8046-1ed3169c4593" returned: 0 in 0.245s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-83a955ce-f112-44d3-8046-1ed3169c4593" released by "delete_volume" :: held 0.629s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Created reservations ['42087291-06c9-4440-a07a-ef53af51ed3a', '14671699-14a2-4b09-8c62-bb2b7fed91ac', '6f6bc6f3-cc84-42b6-8841-e2e0f8a10d28', '878fb967-4755-425d-9def-d3e9f2de1571'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:00 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:53:00 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:00 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:53:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Deleted volume successfully. Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c349541f-9a7c-4771-aa5c-e631f3b520a1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-83a955ce-f112-44d3-8046-1ed3169c4593-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-06d652a7-c162-417f-9e13-d0c3d4d1ccf8-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-06d652a7-c162-417f-9e13-d0c3d4d1ccf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-06d652a7-c162-417f-9e13-d0c3d4d1ccf8" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-06d652a7-c162-417f-9e13-d0c3d4d1ccf8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Deleting offline snapshot 06d652a7-c162-417f-9e13-d0c3d4d1ccf8 of volume 1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] snapshot_file for this snap is: volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b8575b-6ddc-4d70-bd71-04732829a44d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:53:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:00 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 Sep 30 19:53:00 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:01 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8" returned: 0 in 0.360s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:53:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eaa3ba-074c-4767-96a0-9283376df9ac]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:53:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:01 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb Sep 30 19:53:01 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:01 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" returned: 0 in 0.540s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:01 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 Sep 30 19:53:01 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:01 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8" returned: 0 in 0.326s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:01 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8 Sep 30 19:53:01 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:02 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb.06d652a7-c162-417f-9e13-d0c3d4d1ccf8" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-06d652a7-c162-417f-9e13-d0c3d4d1ccf8" released by "_delete_snapshot" :: held 1.566s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" released by "delete_snapshot" :: held 1.585s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Created reservations ['c6d1e30e-8274-48a1-a65f-1d4d17299ae4', 'de776741-f517-4073-8b11-4b0fc86564fd', '316fa8e4-3364-4024-8a83-eb96a0eb4ed5', '5b58ac82-fa5f-423e-b71a-2a22cb1c374a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:53:02 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Delete snapshot completed successfully. Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d287263-6362-41ab-b0c4-908bde754a43 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-06d652a7-c162-417f-9e13-d0c3d4d1ccf8-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab41ab5e-e7f6-4823-98ec-ffdac1f836d5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:53:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:03 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb Sep 30 19:53:03 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:03 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" returned: 0 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:03 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb Sep 30 19:53:03 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:03 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" returned: 0 in 0.247s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb" released by "delete_volume" :: held 0.670s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Created reservations ['c0bbb781-94ad-48c5-9ef8-4e12c1334046', '0c9d8e91-b543-4a4a-ad6d-ea6c2f5eca23', '15ccb14f-e731-4237-b389-ff91851e17c9', '9248d38f-b367-4aab-acd7-e9af7651a988'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:03 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:53:03 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:03 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.252s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:53:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Deleted volume successfully. Sep 30 19:53:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8b4b9635-5eb1-4dec-9681-b04cf57edc9e tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-1e5553a7-6b32-4f23-9c81-dd3b4668f3cb-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-e5a26fec-bb1f-4380-9e4c-6e08da609c42-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-e5a26fec-bb1f-4380-9e4c-6e08da609c42-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "cinder-quobyte-e5a26fec-bb1f-4380-9e4c-6e08da609c42" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-e5a26fec-bb1f-4380-9e4c-6e08da609c42" acquired by "delete_volume" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed26bde-82e7-4ba6-a4ff-52a93d79b89b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:04 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 Sep 30 19:53:04 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:04 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42" returned: 0 in 0.362s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:04 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42 Sep 30 19:53:04 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:04 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e5a26fec-bb1f-4380-9e4c-6e08da609c42" returned: 0 in 0.242s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-quobyte-e5a26fec-bb1f-4380-9e4c-6e08da609c42" released by "delete_volume" :: held 0.663s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Created reservations ['0fb429a5-685d-4709-9b29-e87e6bc02836', '6eb085c9-a048-41d4-ab71-948eeb0698a7', '6c10d5ab-9ab7-4c20-81f7-c4beed9b1acc', '8a171461-580d-434f-bd7a-c51ed31ecd6f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:53:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:04 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:53:04 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:05 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:05 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:53:05 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Deleted volume successfully. Sep 30 19:53:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-16a6543b-70ff-4c6b-9060-9d835193dcb1 tempest-VolumesSnapshotTestJSON-1645704205 None] Lock "cinder-e5a26fec-bb1f-4380-9e4c-6e08da609c42-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:53:14 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=79,cinder:DELETE=4,cinder:SELECT=75,cinder:INSERT=18 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:53:15 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=72,cinder:INSERT=22,cinder:UPDATE=79,cinder:DELETE=9 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:53:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:53:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:53:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:53:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:53:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:53:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:53:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:23 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:53:23 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:24 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:53:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:53:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:53:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Flow 'volume_create_manager' (b4231df7-692d-4dc0-affd-57c692dcfd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc31ea9-32b2-44ed-9ba2-fffcbfe27df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc31ea9-32b2-44ed-9ba2-fffcbfe27df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1751292666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d976c90b-23f9-4943-ad05-4784227d1ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60155d0233ae42f28009d14a186b9558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:53:39Z,use_quota=True,user_id='5e5a6bf833ec45f0b30f700c1b1d3212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2faf3e-255b-4264-a8e3-8e3912150af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2faf3e-255b-4264-a8e3-8e3912150af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f64300-8e10-49dd-9866-64c8f3f4373c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f64300-8e10-49dd-9866-64c8f3f4373c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd976c90b-23f9-4943-ad05-4784227d1ab5', 'volume_name': 'volume-d976c90b-23f9-4943-ad05-4784227d1ab5', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e150d4-3a76-424d-8dbe-34fc94ebfcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e150d4-3a76-424d-8dbe-34fc94ebfcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbff978-3abd-4dcd-952e-b5a85bbce8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:53:39 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Volume d976c90b-23f9-4943-ad05-4784227d1ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d976c90b-23f9-4943-ad05-4784227d1ab5', 'volume_size': 1} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1751292666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d976c90b-23f9-4943-ad05-4784227d1ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60155d0233ae42f28009d14a186b9558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:53:39Z,use_quota=True,user_id='5e5a6bf833ec45f0b30f700c1b1d3212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Creating volume d976c90b-23f9-4943-ad05-4784227d1ab5 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:53:39 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:39 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5 1073741824 Sep 30 19:53:39 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:39 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5 1073741824" returned: 0 in 0.439s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:53:39 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5 Sep 30 19:53:39 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:53:39 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5" returned: 0 in 0.260s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbff978-3abd-4dcd-952e-b5a85bbce8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d976c90b-23f9-4943-ad05-4784227d1ab5', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5d6d37-e3f8-426d-b288-388454114ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:53:39 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Volume volume-d976c90b-23f9-4943-ad05-4784227d1ab5 (d976c90b-23f9-4943-ad05-4784227d1ab5): created successfully Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5d6d37-e3f8-426d-b288-388454114ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:53:39 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Flow 'volume_create_manager' (b4231df7-692d-4dc0-affd-57c692dcfd6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:53:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fe068574-ea05-4d2f-8dcb-a0ba9f576d59 tempest-TestMinimumBasicScenario-184133130 None] Created volume successfully. Sep 30 19:53:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-f929fb60-1c45-4ffc-ab94-34c458be8b21 req-370a4a2c-5631-4a96-8116-1bc4d789c694 tempest-TestMinimumBasicScenario-184133130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:53:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-f929fb60-1c45-4ffc-ab94-34c458be8b21 req-370a4a2c-5631-4a96-8116-1bc4d789c694 tempest-TestMinimumBasicScenario-184133130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:53:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [req-f929fb60-1c45-4ffc-ab94-34c458be8b21 req-370a4a2c-5631-4a96-8116-1bc4d789c694 tempest-TestMinimumBasicScenario-184133130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:53:40 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-f929fb60-1c45-4ffc-ab94-34c458be8b21 req-370a4a2c-5631-4a96-8116-1bc4d789c694 tempest-TestMinimumBasicScenario-184133130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217', 'name': 'volume-d976c90b-23f9-4943-ad05-4784227d1ab5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3979300-d701-46db-91a3-b74b90c6d605', 'enforce_multipath': True} {{(pid=87426) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 19:53:41 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-f929fb60-1c45-4ffc-ab94-34c458be8b21 req-370a4a2c-5631-4a96-8116-1bc4d789c694 tempest-TestMinimumBasicScenario-184133130 None] attachment_update completed successfully. Sep 30 19:53:51 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8,cinder:DELETE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:53:51 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:54:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:54:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:54:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:54:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:54:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:54:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:54:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:54:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:54:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:23 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:54:23 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:24 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.258s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:54:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:54:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:54:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:54:29 devstack cinder-volume[87426]: INFO cinder.volume.manager [req-af9e2032-c53d-48e9-b65b-e129ca3b66b4 req-be1d1bcb-2c26-4153-91da-cc76d6d868cc tempest-TestMinimumBasicScenario-184133130 None] Terminate volume connection completed successfully. Sep 30 19:54:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [req-af9e2032-c53d-48e9-b65b-e129ca3b66b4 req-be1d1bcb-2c26-4153-91da-cc76d6d868cc tempest-TestMinimumBasicScenario-184133130 None] Deleting attachment d3979300-d701-46db-91a3-b74b90c6d605. {{(pid=87426) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Acquiring lock "cinder-d976c90b-23f9-4943-ad05-4784227d1ab5-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Lock "cinder-d976c90b-23f9-4943-ad05-4784227d1ab5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Acquiring lock "cinder-quobyte-d976c90b-23f9-4943-ad05-4784227d1ab5" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Lock "cinder-quobyte-d976c90b-23f9-4943-ad05-4784227d1ab5" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[37daebdb-a51b-4260-ad3c-c2cf61068e1a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:30 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5 Sep 30 19:54:30 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:30 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5" returned: 0 in 0.376s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:30 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5 Sep 30 19:54:30 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:30 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d976c90b-23f9-4943-ad05-4784227d1ab5" returned: 0 in 0.242s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Lock "cinder-quobyte-d976c90b-23f9-4943-ad05-4784227d1ab5" released by "delete_volume" :: held 0.664s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Created reservations ['618f6e2e-7d0b-42f1-966e-3c95d4c0258a', '45336b25-65f8-4870-b043-5f454412602c', 'd6dcc7f5-e59a-474f-8400-58acb904867d', '900943ef-63f6-4093-a12b-33940945215a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:54:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:30 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:54:30 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:31 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.260s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:31 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:54:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Deleted volume successfully. Sep 30 19:54:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e4d8eb72-07da-4694-9cf9-efb723ed1dc4 tempest-TestMinimumBasicScenario-184133130 None] Lock "cinder-d976c90b-23f9-4943-ad05-4784227d1ab5-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:54:40 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:54:41 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:54:44 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:54:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Flow 'volume_create_manager' (8592e5a9-9836-491d-a79c-668bcc12a9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:54:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83a92a4-ec1a-4f67-af30-6097c8d3e9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83a92a4-ec1a-4f67-af30-6097c8d3e9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-264518342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c1cacd-db32-495f-a849-2bf95f87fd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ed9d4c8804a72bb054a55950982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:54:45Z,use_quota=True,user_id='b07c9f0312d84c4fb7427f557903731c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ad9547-179f-4ef3-8bdf-2c3b64efac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ad9547-179f-4ef3-8bdf-2c3b64efac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a176f886-c293-4baf-8a6b-d3e6675aa176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a176f886-c293-4baf-8a6b-d3e6675aa176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c1cacd-db32-495f-a849-2bf95f87fd2d', 'volume_name': 'volume-84c1cacd-db32-495f-a849-2bf95f87fd2d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919e7459-0c01-4d9a-82de-7e679f55cbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919e7459-0c01-4d9a-82de-7e679f55cbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587e7669-9a07-4832-b93c-e883e1595c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:45 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Volume 84c1cacd-db32-495f-a849-2bf95f87fd2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c1cacd-db32-495f-a849-2bf95f87fd2d', 'volume_size': 1} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-264518342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c1cacd-db32-495f-a849-2bf95f87fd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ed9d4c8804a72bb054a55950982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:54:45Z,use_quota=True,user_id='b07c9f0312d84c4fb7427f557903731c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Creating volume 84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:54:45 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:45 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d 1073741824 Sep 30 19:54:45 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:45 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d 1073741824" returned: 0 in 0.409s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:45 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d Sep 30 19:54:45 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:45 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d" returned: 0 in 0.252s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587e7669-9a07-4832-b93c-e883e1595c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c1cacd-db32-495f-a849-2bf95f87fd2d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e260ae-1752-4c7b-b64a-a4cafef0339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:45 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Volume volume-84c1cacd-db32-495f-a849-2bf95f87fd2d (84c1cacd-db32-495f-a849-2bf95f87fd2d): created successfully Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e260ae-1752-4c7b-b64a-a4cafef0339d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:45 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Flow 'volume_create_manager' (8592e5a9-9836-491d-a79c-668bcc12a9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:54:45 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d73c6f82-47f5-44fa-bd41-7049f635f495 tempest-VolumeDependencyTests-1467759084 None] Created volume successfully. Sep 30 19:54:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:54:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:54:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Creating offline snapshot e0e43770-17c6-44ca-a1eb-1e26b3a8778b of volume 84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:54:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[005a7d51-a9f5-43fa-bade-a4fc5fbe15dc]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:54:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:46 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d Sep 30 19:54:46 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:46 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d" returned: 0 in 0.364s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:46 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b 1G Sep 30 19:54:46 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:46 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b 1G" returned: 0 in 0.395s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84c1cacd-db32-495f-a849-2bf95f87fd2d -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:46 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84c1cacd-db32-495f-a849-2bf95f87fd2d -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b Sep 30 19:54:46 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:47 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84c1cacd-db32-495f-a849-2bf95f87fd2d -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b" returned: 0 in 0.283s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:47 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b is being set with open permissions: ugo+rw Sep 30 19:54:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:47 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b Sep 30 19:54:47 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:47 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:47 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.info Sep 30 19:54:47 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:47 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.info" returned: 0 in 0.246s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:47 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.info is being set with open permissions: ugo+rw Sep 30 19:54:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:47 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.info Sep 30 19:54:47 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:47 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.info" returned: 0 in 0.240s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:54:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-40a79d2c-2b06-48d7-930f-93af195ce20e tempest-VolumeDependencyTests-1467759084 None] Create snapshot completed successfully Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Flow 'volume_create_manager' (037477d2-b8b4-4b46-84c1-948c9e45044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376b00b1-96cd-462b-8f3d-3b76348c257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376b00b1-96cd-462b-8f3d-3b76348c257e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-270518722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183c63bb-243e-4b0b-a1fc-7593d7f3b156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314ed9d4c8804a72bb054a55950982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e0e43770-17c6-44ca-a1eb-1e26b3a8778b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:54:49Z,use_quota=True,user_id='b07c9f0312d84c4fb7427f557903731c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5c02dc-3848-483a-942e-65558719862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5c02dc-3848-483a-942e-65558719862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae4c4a1-6c82-4e55-b914-d3fe082cdf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae4c4a1-6c82-4e55-b914-d3fe082cdf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '183c63bb-243e-4b0b-a1fc-7593d7f3b156', 'volume_name': 'volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156', 'volume_size': 1, 'snapshot_id': 'e0e43770-17c6-44ca-a1eb-1e26b3a8778b'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5f7f47-19f1-4879-a169-0faa574fa13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5f7f47-19f1-4879-a169-0faa574fa13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac5ea33-b0a8-498b-a206-432b9c624659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:48 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Volume 183c63bb-243e-4b0b-a1fc-7593d7f3b156: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156', 'volume_size': 1, 'snapshot_id': 'e0e43770-17c6-44ca-a1eb-1e26b3a8778b'} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "cinder-quobyte-e0e43770-17c6-44ca-a1eb-1e26b3a8778b-183c63bb-243e-4b0b-a1fc-7593d7f3b156" by "_create_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-e0e43770-17c6-44ca-a1eb-1e26b3a8778b-183c63bb-243e-4b0b-a1fc-7593d7f3b156" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Creating volume 183c63bb-243e-4b0b-a1fc-7593d7f3b156 from snapshot e0e43770-17c6-44ca-a1eb-1e26b3a8778b {{(pid=87426) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "cinder-quobyte-183c63bb-243e-4b0b-a1fc-7593d7f3b156" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-183c63bb-243e-4b0b-a1fc-7593d7f3b156" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] snapshot: e0e43770-17c6-44ca-a1eb-1e26b3a8778b, volume: 183c63bb-243e-4b0b-a1fc-7593d7f3b156, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef3908f-578e-4e72-bfbf-64e26760de35]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:54:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:49 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b Sep 30 19:54:49 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:49 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b" returned: 0 in 0.368s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84c1cacd-db32-495f-a849-2bf95f87fd2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:54:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73daec2-a78e-4745-b87d-0c2f37103fea]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:54:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:49 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d Sep 30 19:54:49 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:49 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d" returned: 0 in 0.372s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:54:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:54:49 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:54:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:49 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 Sep 30 19:54:49 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:55 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156" returned: 0 in 6.108s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:55 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:54:55 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Converted 1024.00 MB image at 167.60 MB/s Sep 30 19:54:55 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 is being set with open permissions: ugo+rw Sep 30 19:54:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:55 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 Sep 30 19:54:55 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:56 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156" returned: 0 in 0.246s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-183c63bb-243e-4b0b-a1fc-7593d7f3b156" released by "_copy_volume_from_snapshot" :: held 7.181s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-e0e43770-17c6-44ca-a1eb-1e26b3a8778b-183c63bb-243e-4b0b-a1fc-7593d7f3b156" released by "_create_volume_from_snapshot" :: held 7.239s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.265s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac5ea33-b0a8-498b-a206-432b9c624659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156', 'volume_size': 1, 'snapshot_id': 'e0e43770-17c6-44ca-a1eb-1e26b3a8778b'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0133ae18-12b4-4072-97de-46dc27b15c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:54:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Volume volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 (183c63bb-243e-4b0b-a1fc-7593d7f3b156): created successfully Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0133ae18-12b4-4072-97de-46dc27b15c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Flow 'volume_create_manager' (037477d2-b8b4-4b46-84c1-948c9e45044d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:54:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a69c5f08-7ed3-47f2-a021-ad78ee2f90ad tempest-VolumeDependencyTests-1467759084 None] Created volume successfully. Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "cinder-e0e43770-17c6-44ca-a1eb-1e26b3a8778b-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-e0e43770-17c6-44ca-a1eb-1e26b3a8778b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "cinder-quobyte-84c1cacd-db32-495f-a849-2bf95f87fd2d" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-84c1cacd-db32-495f-a849-2bf95f87fd2d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "cinder-quobyte-e0e43770-17c6-44ca-a1eb-1e26b3a8778b" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-e0e43770-17c6-44ca-a1eb-1e26b3a8778b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Deleting offline snapshot e0e43770-17c6-44ca-a1eb-1e26b3a8778b of volume 84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] snapshot_file for this snap is: volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8221d8-a2a4-4e33-b8d9-54dd3a01bd0b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:56 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b Sep 30 19:54:56 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:56 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b" returned: 0 in 0.352s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84c1cacd-db32-495f-a849-2bf95f87fd2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce8a2c-0d0c-45c9-8c3b-ec9061d045ed]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:54:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:56 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d Sep 30 19:54:56 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:57 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d" returned: 0 in 0.544s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:57 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b Sep 30 19:54:57 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:57 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b" returned: 0 in 0.327s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:57 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b Sep 30 19:54:57 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:57 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d.e0e43770-17c6-44ca-a1eb-1e26b3a8778b" returned: 0 in 0.247s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-e0e43770-17c6-44ca-a1eb-1e26b3a8778b" released by "_delete_snapshot" :: held 1.574s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:54:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-84c1cacd-db32-495f-a849-2bf95f87fd2d" released by "delete_snapshot" :: held 1.599s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:54:57 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Created reservations ['7f95a00d-0309-4a6a-8cfd-cd75041bf4cd', '2783c4dc-85b2-44fa-918b-ac0ab9017c94', 'e105b077-8a5f-4a28-8024-10615a43f7db', '38ef4378-47e6-4351-b581-e784e7f97f41'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:54:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Delete snapshot completed successfully. Sep 30 19:54:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-82189725-52c4-4b42-9ce9-a8838eb62415 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-e0e43770-17c6-44ca-a1eb-1e26b3a8778b-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:54:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "cinder-84c1cacd-db32-495f-a849-2bf95f87fd2d-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-84c1cacd-db32-495f-a849-2bf95f87fd2d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "cinder-quobyte-84c1cacd-db32-495f-a849-2bf95f87fd2d" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-84c1cacd-db32-495f-a849-2bf95f87fd2d" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e70bdfb-3f58-4ccf-b48a-81967b4d3e93]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:54:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:58 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d Sep 30 19:54:58 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:58 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d" returned: 0 in 0.357s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:58 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d Sep 30 19:54:58 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:59 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-84c1cacd-db32-495f-a849-2bf95f87fd2d" returned: 0 in 0.245s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-84c1cacd-db32-495f-a849-2bf95f87fd2d" released by "delete_volume" :: held 0.663s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Created reservations ['fd1c55d9-bf3e-450d-9ac5-3404f8804356', '86604dd2-86c0-463f-9a23-2fdb7f1647f7', '611f13a4-935a-45db-87ea-bf7a2e4d43c4', 'b4f76afa-6fa4-4355-9e21-62b537270bef'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:59 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:54:59 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:59 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:54:59 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Deleted volume successfully. Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f6e1bf8e-fed5-44e3-a9c8-443cda3df4a2 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-84c1cacd-db32-495f-a849-2bf95f87fd2d-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "cinder-183c63bb-243e-4b0b-a1fc-7593d7f3b156-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-183c63bb-243e-4b0b-a1fc-7593d7f3b156-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "cinder-quobyte-183c63bb-243e-4b0b-a1fc-7593d7f3b156" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-183c63bb-243e-4b0b-a1fc-7593d7f3b156" acquired by "delete_volume" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a170da2-dca7-4d10-827a-2213cdbe059e]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:54:59 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 Sep 30 19:54:59 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:54:59 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156" returned: 0 in 0.360s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:54:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:00 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156 Sep 30 19:55:00 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:00 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-183c63bb-243e-4b0b-a1fc-7593d7f3b156" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-quobyte-183c63bb-243e-4b0b-a1fc-7593d7f3b156" released by "delete_volume" :: held 0.644s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Created reservations ['55ee00c3-0430-4d63-8c14-b782a20274b0', 'd1e218eb-8904-4784-b1b6-f5b3aba69daa', '5308d140-8212-4d09-bd7e-3f97cf032650', 'b2592f48-b6e5-4bc0-b993-87cf5a3a7fb2'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:00 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:00 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:00 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.252s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Deleted volume successfully. Sep 30 19:55:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-30296f4a-77d2-4178-940c-901e080883d4 tempest-VolumeDependencyTests-1467759084 None] Lock "cinder-183c63bb-243e-4b0b-a1fc-7593d7f3b156-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:03 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Flow 'volume_create_manager' (9c6d872f-a981-4d27-83b2-30089d66724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab285a0f-c352-40f8-9774-01075d6d6a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab285a0f-c352-40f8-9774-01075d6d6a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137171405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24063ab2-a2ca-4f08-b87d-78e80a831620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d22be67a452740fcb93f9933bf1878ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:04Z,use_quota=True,user_id='5baf3d9ef4364e8b967d2c5f964028a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e9a2c5-0ad9-41ff-96c6-f3e1fbd1b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e9a2c5-0ad9-41ff-96c6-f3e1fbd1b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ed79e9-82f6-4c3a-b9da-9671071f9766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ed79e9-82f6-4c3a-b9da-9671071f9766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24063ab2-a2ca-4f08-b87d-78e80a831620', 'volume_name': 'volume-24063ab2-a2ca-4f08-b87d-78e80a831620', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c8d5a8-fc09-457a-bf45-c49a24005a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c8d5a8-fc09-457a-bf45-c49a24005a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1506e60-2d6a-4d62-ade8-eace11392c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:04 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Volume 24063ab2-a2ca-4f08-b87d-78e80a831620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24063ab2-a2ca-4f08-b87d-78e80a831620', 'volume_size': 1} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137171405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24063ab2-a2ca-4f08-b87d-78e80a831620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d22be67a452740fcb93f9933bf1878ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:04Z,use_quota=True,user_id='5baf3d9ef4364e8b967d2c5f964028a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Creating volume 24063ab2-a2ca-4f08-b87d-78e80a831620 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:04 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:04 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620 1073741824 Sep 30 19:55:04 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:04 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620 1073741824" returned: 0 in 0.407s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:04 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620 Sep 30 19:55:04 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:04 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620" returned: 0 in 0.239s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1506e60-2d6a-4d62-ade8-eace11392c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24063ab2-a2ca-4f08-b87d-78e80a831620', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2387d44-a141-415a-b8f4-80d5dbf0af98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:04 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Volume volume-24063ab2-a2ca-4f08-b87d-78e80a831620 (24063ab2-a2ca-4f08-b87d-78e80a831620): created successfully Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2387d44-a141-415a-b8f4-80d5dbf0af98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Flow 'volume_create_manager' (9c6d872f-a981-4d27-83b2-30089d66724c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:04 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0fb5b143-b555-44c1-9c7f-02128a7db18d tempest-ProjectReaderTests-342828542 None] Created volume successfully. Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Acquiring lock "cinder-24063ab2-a2ca-4f08-b87d-78e80a831620-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Lock "cinder-24063ab2-a2ca-4f08-b87d-78e80a831620-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Acquiring lock "cinder-quobyte-24063ab2-a2ca-4f08-b87d-78e80a831620" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Lock "cinder-quobyte-24063ab2-a2ca-4f08-b87d-78e80a831620" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1f5762-f384-490b-94f1-ead27abefdb4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:05 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620 Sep 30 19:55:05 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:05 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620" returned: 0 in 0.356s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:05 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620 Sep 30 19:55:05 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:05 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-24063ab2-a2ca-4f08-b87d-78e80a831620" returned: 0 in 0.246s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Lock "cinder-quobyte-24063ab2-a2ca-4f08-b87d-78e80a831620" released by "delete_volume" :: held 0.642s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Created reservations ['bb26a800-9523-4a8d-8142-3ed82e3d0c30', 'a1c27452-7cbb-4101-8025-de1eb51af3a8', '5f73124d-618e-4e3f-82cc-9fa7eeb5cdcc', '3cfd904c-3c61-46b1-87ff-ff1dde1f8127'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:05 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:05 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:06 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.237s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:06 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Deleted volume successfully. Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-082963f4-4fb9-4fa7-bb25-365a7ea40f7b tempest-ProjectReaderTests-342828542 None] Lock "cinder-24063ab2-a2ca-4f08-b87d-78e80a831620-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Flow 'volume_create_manager' (d05f6851-fa2c-4e15-9f94-e8ef8779109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83aaa8ac-2e52-4408-a72a-08c278bdfb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83aaa8ac-2e52-4408-a72a-08c278bdfb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102517964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eed9a32-51c7-4ab9-be8f-508a7094080d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d22be67a452740fcb93f9933bf1878ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:07Z,use_quota=True,user_id='5baf3d9ef4364e8b967d2c5f964028a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cf0b38-70f1-47be-b8e9-9f0a498d833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cf0b38-70f1-47be-b8e9-9f0a498d833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa91d14-fcdc-4166-a588-b467b4514f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa91d14-fcdc-4166-a588-b467b4514f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eed9a32-51c7-4ab9-be8f-508a7094080d', 'volume_name': 'volume-2eed9a32-51c7-4ab9-be8f-508a7094080d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03192cd1-88e9-4691-871d-772775b32ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03192cd1-88e9-4691-871d-772775b32ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b52cba-f047-47a2-b792-ee41a33316c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:06 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Volume 2eed9a32-51c7-4ab9-be8f-508a7094080d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eed9a32-51c7-4ab9-be8f-508a7094080d', 'volume_size': 1} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102517964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eed9a32-51c7-4ab9-be8f-508a7094080d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d22be67a452740fcb93f9933bf1878ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:07Z,use_quota=True,user_id='5baf3d9ef4364e8b967d2c5f964028a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Creating volume 2eed9a32-51c7-4ab9-be8f-508a7094080d {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:06 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:06 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d 1073741824 Sep 30 19:55:06 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:07 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d 1073741824" returned: 0 in 0.413s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:07 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d Sep 30 19:55:07 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:07 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d" returned: 0 in 0.240s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b52cba-f047-47a2-b792-ee41a33316c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eed9a32-51c7-4ab9-be8f-508a7094080d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64053c6-a1cc-412d-94d1-5399254a1901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:07 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Volume volume-2eed9a32-51c7-4ab9-be8f-508a7094080d (2eed9a32-51c7-4ab9-be8f-508a7094080d): created successfully Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64053c6-a1cc-412d-94d1-5399254a1901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Flow 'volume_create_manager' (d05f6851-fa2c-4e15-9f94-e8ef8779109e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:07 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8842f421-62c3-4321-959f-1a8f85ca7487 tempest-ProjectReaderTests-342828542 None] Created volume successfully. Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Acquiring lock "cinder-2eed9a32-51c7-4ab9-be8f-508a7094080d-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Lock "cinder-2eed9a32-51c7-4ab9-be8f-508a7094080d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Acquiring lock "cinder-quobyte-2eed9a32-51c7-4ab9-be8f-508a7094080d" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Lock "cinder-quobyte-2eed9a32-51c7-4ab9-be8f-508a7094080d" acquired by "delete_volume" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceea964-0bfe-4db6-8f32-616046ca6201]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:07 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d Sep 30 19:55:07 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:08 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d" returned: 0 in 0.354s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:08 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d Sep 30 19:55:08 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:08 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2eed9a32-51c7-4ab9-be8f-508a7094080d" returned: 0 in 0.237s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Lock "cinder-quobyte-2eed9a32-51c7-4ab9-be8f-508a7094080d" released by "delete_volume" :: held 0.633s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Created reservations ['639071d5-8139-440d-bdf8-01c44baa8b55', '7e9569ff-cbb5-4125-98c7-1ee540870bd4', '93b18350-416a-4056-8817-8a5e403647a5', 'fb756a21-21fe-4383-88f5-4a5677df8d2f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:08 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:08 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:08 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:08 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Deleted volume successfully. Sep 30 19:55:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6ff07216-a22f-4b64-8d67-fee727e7c06b tempest-ProjectReaderTests-342828542 None] Lock "cinder-2eed9a32-51c7-4ab9-be8f-508a7094080d-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:18 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=46,cinder:INSERT=13,cinder:UPDATE=45,cinder:DELETE=6 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:55:18 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=61,cinder:SELECT=35,cinder:DELETE=3,cinder:INSERT=12 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:55:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:55:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:23 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:23 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:24 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.335s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:55:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:55:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (abcbe68b-edee-4b1e-8906-7e7987212a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b1117a-0ba6-4e42-b29a-0194237ba29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b1117a-0ba6-4e42-b29a-0194237ba29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151943550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa27373-6822-470f-bc72-c8cf5d18fdf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:25Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07570619-4a98-4efb-aeed-5ec2c090afc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07570619-4a98-4efb-aeed-5ec2c090afc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13ca5e0-e01f-4f77-98a8-3b552ec28f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13ca5e0-e01f-4f77-98a8-3b552ec28f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fa27373-6822-470f-bc72-c8cf5d18fdf0', 'volume_name': 'volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9791e1d-06df-470c-bbff-bbd2d37bab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9791e1d-06df-470c-bbff-bbd2d37bab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93abe49c-0fc1-478c-b723-1f45344d5f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume 7fa27373-6822-470f-bc72-c8cf5d18fdf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0', 'volume_size': 1} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151943550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa27373-6822-470f-bc72-c8cf5d18fdf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:25Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Creating volume 7fa27373-6822-470f-bc72-c8cf5d18fdf0 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:25 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:25 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 1073741824 Sep 30 19:55:25 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (dc88c839-3c26-4651-a55d-9f18c504ec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64073ac4-4db1-4c89-b004-0125f354abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64073ac4-4db1-4c89-b004-0125f354abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-381266822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79258497-7b41-428a-8d82-8f4acdb2507e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:26Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d58f96a-9deb-4fd7-93a1-f111aa942fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d58f96a-9deb-4fd7-93a1-f111aa942fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956c6012-99d2-41d2-a49e-01a0c216f90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956c6012-99d2-41d2-a49e-01a0c216f90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79258497-7b41-428a-8d82-8f4acdb2507e', 'volume_name': 'volume-79258497-7b41-428a-8d82-8f4acdb2507e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7887714b-9f1b-4990-b3f3-58959dd65ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7887714b-9f1b-4990-b3f3-58959dd65ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89af458b-e7b3-479e-b0ed-2ca6984f1cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:25 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Volume 79258497-7b41-428a-8d82-8f4acdb2507e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79258497-7b41-428a-8d82-8f4acdb2507e', 'volume_size': 1} Sep 30 19:55:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:26 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 1073741824" returned: 0 in 0.630s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:26 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 Sep 30 19:55:26 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (a200c9d0-82f0-414a-b077-2523563dc4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846e596d-666e-48fd-9652-4482105f24e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846e596d-666e-48fd-9652-4482105f24e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1785721950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4510ec0-f85c-4ddf-bc26-475ce6b43cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:26Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b667e7f6-1067-4c08-b862-72fe65032e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b667e7f6-1067-4c08-b862-72fe65032e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61e7b63-41e8-4c02-ab29-b5d6bee2112d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61e7b63-41e8-4c02-ab29-b5d6bee2112d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4510ec0-f85c-4ddf-bc26-475ce6b43cb0', 'volume_name': 'volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0112906-9578-45d3-9f57-d9941bc0ac86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0112906-9578-45d3-9f57-d9941bc0ac86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf31b7f8-0ff1-4455-a308-9c6ce8d5b2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Volume d4510ec0-f85c-4ddf-bc26-475ce6b43cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0', 'volume_size': 1} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:26 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0" returned: 0 in 0.351s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-381266822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79258497-7b41-428a-8d82-8f4acdb2507e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:26Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Creating volume 79258497-7b41-428a-8d82-8f4acdb2507e {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:26 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:26 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e 1073741824 Sep 30 19:55:26 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93abe49c-0fc1-478c-b723-1f45344d5f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef776dee-e75a-45bb-a422-b46bee632933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 (7fa27373-6822-470f-bc72-c8cf5d18fdf0): created successfully Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef776dee-e75a-45bb-a422-b46bee632933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (abcbe68b-edee-4b1e-8906-7e7987212a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:26 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-40dc4ee1-ef09-413f-97ef-d79efc0e84f8 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created volume successfully. Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (6a1b00f6-ee50-4ff5-b913-3d2cb7e15341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebe980f-6ee6-4339-b2c2-0ae19ea8129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-9cf6d98f-59cd-4410-bda9-25d6d4d46bac tempest-ProjectAdminTests-270269350 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8975448608398, 'free_capacity_gb': 1774.8975448608398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87426) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebe980f-6ee6-4339-b2c2-0ae19ea8129d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-334653155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfcb1da4-a3df-4bf3-b4a5-456dbf6617da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:27Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd88a28e-bc5d-411f-916e-fd9fd3b3e228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd88a28e-bc5d-411f-916e-fd9fd3b3e228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f37fa98-7768-4d09-8077-d29396864330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f37fa98-7768-4d09-8077-d29396864330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfcb1da4-a3df-4bf3-b4a5-456dbf6617da', 'volume_name': 'volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54f55d5-8a59-4aa8-be3a-cbd3ae956306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54f55d5-8a59-4aa8-be3a-cbd3ae956306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bfae0f-dadb-4ab7-aed3-4c0d86c6d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:26 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Volume dfcb1da4-a3df-4bf3-b4a5-456dbf6617da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da', 'volume_size': 1} Sep 30 19:55:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:27 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (0a5e3383-8a65-41e8-a015-eaaad4f8bae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e81fa5e-e833-47e5-8c5c-0f56eb8136c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e 1073741824" returned: 0 in 0.792s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e81fa5e-e833-47e5-8c5c-0f56eb8136c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-624714623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e799b8f-fcae-4401-b2d5-8635d40c393b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:27Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a78e4b-eb1a-457a-96bc-7e3351ac0c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a78e4b-eb1a-457a-96bc-7e3351ac0c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e6c0a4-8396-4be9-8dfb-e2734dac71b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e6c0a4-8396-4be9-8dfb-e2734dac71b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e799b8f-fcae-4401-b2d5-8635d40c393b', 'volume_name': 'volume-2e799b8f-fcae-4401-b2d5-8635d40c393b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a1306d-38c9-488d-b408-b73319b063eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a1306d-38c9-488d-b408-b73319b063eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c361eed4-e6c3-4071-9e14-9b3f595fae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Volume 2e799b8f-fcae-4401-b2d5-8635d40c393b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e799b8f-fcae-4401-b2d5-8635d40c393b', 'volume_size': 1} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:27 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e Sep 30 19:55:27 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (e551fbf8-72e2-4bf2-84a8-3075c84e657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8e19d2-1095-4d00-be8d-bc1370913afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8e19d2-1095-4d00-be8d-bc1370913afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733557797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d239dc-2e8d-43d5-a3b4-77867f309627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:28Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711ec69e-4c15-4fd7-8e5d-2ee2e2d20d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711ec69e-4c15-4fd7-8e5d-2ee2e2d20d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33662c64-0dbe-457e-b63c-f436773bf364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33662c64-0dbe-457e-b63c-f436773bf364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d239dc-2e8d-43d5-a3b4-77867f309627', 'volume_name': 'volume-59d239dc-2e8d-43d5-a3b4-77867f309627', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a501a15-ee48-4db1-a39b-909ee960069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a501a15-ee48-4db1-a39b-909ee960069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b1a030-6c32-4b70-a2b8-8d13ab915357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Volume 59d239dc-2e8d-43d5-a3b4-77867f309627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d239dc-2e8d-43d5-a3b4-77867f309627', 'volume_size': 1} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:27 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e" returned: 0 in 0.330s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1785721950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4510ec0-f85c-4ddf-bc26-475ce6b43cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:26Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Creating volume d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:27 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89af458b-e7b3-479e-b0ed-2ca6984f1cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79258497-7b41-428a-8d82-8f4acdb2507e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecb42a1-a6ef-4599-b48e-21c1ccafe159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Volume volume-79258497-7b41-428a-8d82-8f4acdb2507e (79258497-7b41-428a-8d82-8f4acdb2507e): created successfully Sep 30 19:55:27 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 1073741824 Sep 30 19:55:27 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecb42a1-a6ef-4599-b48e-21c1ccafe159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (dc88c839-3c26-4651-a55d-9f18c504ec83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d7c58b2e-c495-48ea-b655-75e5b0be4777 tempest-CreateVolumesFromImageTest-1340733447 None] Created volume successfully. Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (3a351941-b30c-441d-9de5-29dd69aa26ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcf0803-bce4-4dde-8fc3-bdaad468f90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcf0803-bce4-4dde-8fc3-bdaad468f90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366327640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e19c9ab-aad2-4884-818a-20e4928dd8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:28Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b000de-6894-4edd-a7c2-b31d5ebc4bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b000de-6894-4edd-a7c2-b31d5ebc4bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255db2f1-7ed5-42e5-8daf-9b2a6389b6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255db2f1-7ed5-42e5-8daf-9b2a6389b6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e19c9ab-aad2-4884-818a-20e4928dd8b8', 'volume_name': 'volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6740eb-85fc-4511-b56c-73bf6213e654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6740eb-85fc-4511-b56c-73bf6213e654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d90455-980f-459b-8948-65a324939ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:28 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume 4e19c9ab-aad2-4884-818a-20e4928dd8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8', 'volume_size': 1} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:28 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 1073741824" returned: 0 in 0.702s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:28 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 Sep 30 19:55:28 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:28 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0" returned: 0 in 0.402s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.983s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-334653155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfcb1da4-a3df-4bf3-b4a5-456dbf6617da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:27Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Creating volume dfcb1da4-a3df-4bf3-b4a5-456dbf6617da {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:28 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:28 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da 1073741824 Sep 30 19:55:28 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf31b7f8-0ff1-4455-a308-9c6ce8d5b2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6263514-f37c-42a4-a83a-97a4fe5469d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (4e7e80f0-a59c-4dc9-8b67-e641c5bf86eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6500df24-4cb4-448e-b9f0-45dfacb94104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Volume volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 (d4510ec0-f85c-4ddf-bc26-475ce6b43cb0): created successfully Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6263514-f37c-42a4-a83a-97a4fe5469d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (a200c9d0-82f0-414a-b077-2523563dc4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6500df24-4cb4-448e-b9f0-45dfacb94104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-521369890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bce91ad-0d57-4d07-a0d0-a63f4f6fb060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:29Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9db8e2-eb9e-411f-8896-c5b196a4f16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9db8e2-eb9e-411f-8896-c5b196a4f16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3369e3bd-e9d2-4b58-9a29-ff63a1e4c35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3369e3bd-e9d2-4b58-9a29-ff63a1e4c35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bce91ad-0d57-4d07-a0d0-a63f4f6fb060', 'volume_name': 'volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc3e3f9-b89c-49ca-a959-ed8a4df69e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc3e3f9-b89c-49ca-a959-ed8a4df69e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c532215-b271-41cd-9512-7064e9f075a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume 6bce91ad-0d57-4d07-a0d0-a63f4f6fb060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060', 'volume_size': 1} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:29 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8949f586-e8fb-470b-8f42-e4b8acdb84ea tempest-CreateVolumesFromImageTest-1340733447 None] Created volume successfully. Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (768b12c8-6cad-491a-b88f-51b05c809d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeec1c39-a91a-4ad6-8293-4b01d3b3b8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeec1c39-a91a-4ad6-8293-4b01d3b3b8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074273775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de498bb-0080-4d40-869f-0d82b05fc671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:29Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1951a20b-1377-4f2a-8cd9-552f8e2e1890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1951a20b-1377-4f2a-8cd9-552f8e2e1890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0832667-c0e0-4d3e-b59c-5585e9d33054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0832667-c0e0-4d3e-b59c-5585e9d33054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de498bb-0080-4d40-869f-0d82b05fc671', 'volume_name': 'volume-7de498bb-0080-4d40-869f-0d82b05fc671', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff74cfa-3f6e-4bfc-be88-db658ea9a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff74cfa-3f6e-4bfc-be88-db658ea9a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ca7bf6-5d91-4aee-9b0a-8318cc3167b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:29 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume 7de498bb-0080-4d40-869f-0d82b05fc671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de498bb-0080-4d40-869f-0d82b05fc671', 'volume_size': 1} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:29 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da 1073741824" returned: 0 in 0.760s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:29 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da Sep 30 19:55:29 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (b9b33778-e19b-4936-8a54-6e579bbefe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2077bf93-60a0-4f40-97e2-1bf94108c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2077bf93-60a0-4f40-97e2-1bf94108c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1214242754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86216f36-0065-4097-b4d9-6036e0c2116d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:30Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc9bad9-cff4-4813-aa04-c95d39488a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc9bad9-cff4-4813-aa04-c95d39488a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4aba351-8dae-4abd-87cf-d84653bab81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4aba351-8dae-4abd-87cf-d84653bab81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86216f36-0065-4097-b4d9-6036e0c2116d', 'volume_name': 'volume-86216f36-0065-4097-b4d9-6036e0c2116d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320fd035-8330-4fe0-8911-a58379b53f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320fd035-8330-4fe0-8911-a58379b53f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039aac7a-3482-420a-aa6f-7169a77de78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume 86216f36-0065-4097-b4d9-6036e0c2116d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86216f36-0065-4097-b4d9-6036e0c2116d', 'volume_size': 1} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:30 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da" returned: 0 in 0.379s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.799s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-624714623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e799b8f-fcae-4401-b2d5-8635d40c393b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:27Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Creating volume 2e799b8f-fcae-4401-b2d5-8635d40c393b {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:30 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bfae0f-dadb-4ab7-aed3-4c0d86c6d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b 1073741824 Sep 30 19:55:30 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ed2d7a-7d79-412b-8374-5ec71b9a7048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Volume volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da (dfcb1da4-a3df-4bf3-b4a5-456dbf6617da): created successfully Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ed2d7a-7d79-412b-8374-5ec71b9a7048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (6a1b00f6-ee50-4ff5-b913-3d2cb7e15341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-98c0a79b-77d7-4b20-aaa6-f44ad51dae13 tempest-CreateVolumesFromImageTest-1340733447 None] Created volume successfully. Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (75ebf266-f851-4c09-8040-4f5a86a6cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28f9d54-befb-4da2-88ba-2f73d2011093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28f9d54-befb-4da2-88ba-2f73d2011093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502001216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc288c5-7763-4778-a595-8d8c70e54a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:30Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cedcff-e0a7-4fb0-91cd-1fcff7c4a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cedcff-e0a7-4fb0-91cd-1fcff7c4a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1455d7-c7ec-4bd0-949e-eca1e36d23d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1455d7-c7ec-4bd0-949e-eca1e36d23d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc288c5-7763-4778-a595-8d8c70e54a4a', 'volume_name': 'volume-cdc288c5-7763-4778-a595-8d8c70e54a4a', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d193ee-1165-4017-adcc-908743cee8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d193ee-1165-4017-adcc-908743cee8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4186e9-ac1c-444a-9a94-7cb37118dc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:30 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume cdc288c5-7763-4778-a595-8d8c70e54a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc288c5-7763-4778-a595-8d8c70e54a4a', 'volume_size': 1} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:30 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b 1073741824" returned: 0 in 0.505s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:30 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b Sep 30 19:55:30 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:31 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b" returned: 0 in 0.313s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.343s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733557797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d239dc-2e8d-43d5-a3b4-77867f309627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8681eae8817e42f7aed2fd11d844b965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:28Z,use_quota=True,user_id='5498402a156348f5bc282b0e6fcd945c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Creating volume 59d239dc-2e8d-43d5-a3b4-77867f309627 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:31 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c361eed4-e6c3-4071-9e14-9b3f595fae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e799b8f-fcae-4401-b2d5-8635d40c393b', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04532d5-8dcd-407b-b759-5f90cd1a0d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:31 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627 1073741824 Sep 30 19:55:31 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:31 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Volume volume-2e799b8f-fcae-4401-b2d5-8635d40c393b (2e799b8f-fcae-4401-b2d5-8635d40c393b): created successfully Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04532d5-8dcd-407b-b759-5f90cd1a0d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (0a5e3383-8a65-41e8-a015-eaaad4f8bae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-16515eaf-253f-404c-899f-75b9e4dd7aa9 tempest-CreateVolumesFromImageTest-1340733447 None] Created volume successfully. Sep 30 19:55:31 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627 1073741824" returned: 0 in 0.528s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:31 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627 Sep 30 19:55:31 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:31 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627" returned: 0 in 0.319s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.548s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366327640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e19c9ab-aad2-4884-818a-20e4928dd8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:28Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Creating volume 4e19c9ab-aad2-4884-818a-20e4928dd8b8 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:31 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b1a030-6c32-4b70-a2b8-8d13ab915357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d239dc-2e8d-43d5-a3b4-77867f309627', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 1073741824 Sep 30 19:55:32 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a85eed-8a89-4539-a634-43f030cb2b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Volume volume-59d239dc-2e8d-43d5-a3b4-77867f309627 (59d239dc-2e8d-43d5-a3b4-77867f309627): created successfully Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a85eed-8a89-4539-a634-43f030cb2b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Flow 'volume_create_manager' (e551fbf8-72e2-4bf2-84a8-3075c84e657b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Flow 'volume_create_manager' (74ce2522-8400-4ac3-ae18-972cb4811fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd36637-70c1-4bd3-8fa8-601da15d9ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a7e88d36-36e8-4f68-a170-11d457d07239 tempest-CreateVolumesFromImageTest-1340733447 None] Created volume successfully. Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd36637-70c1-4bd3-8fa8-601da15d9ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f458552-eae4-4f97-b9e8-0da9563869f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59006fd57a4e47648a26eeff75926778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:32Z,use_quota=True,user_id='7cdac16ad24d49cc99f91c42c62ca0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d5b4ea-7d36-4eaf-a23b-3a5ca52d1889),volume_type_id=81d5b4ea-7d36-4eaf-a23b-3a5ca52d1889)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4ba384-e0d6-4bb1-bd03-29db93e9ae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4ba384-e0d6-4bb1-bd03-29db93e9ae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a3eb2a-08f6-4771-aac8-c13677dfab95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (67f2bdce-c06f-4b2d-a6c8-bf420ab1da2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb7bb58-6d92-46ac-bf54-da9ee0e9ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb7bb58-6d92-46ac-bf54-da9ee0e9ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1196410250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee487e8-fb75-41b5-aeb5-839aa41f3900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:32Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cbe896-6150-4041-bd79-0b491265ce88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cbe896-6150-4041-bd79-0b491265ce88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e4189d-cfc2-4b57-8eff-1e7a25a1c7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e4189d-cfc2-4b57-8eff-1e7a25a1c7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee487e8-fb75-41b5-aeb5-839aa41f3900', 'volume_name': 'volume-eee487e8-fb75-41b5-aeb5-839aa41f3900', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3d7e66-0681-4fa2-9222-066975231d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3d7e66-0681-4fa2-9222-066975231d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5330f92f-88de-4fcc-804c-50061e5b2ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Volume eee487e8-fb75-41b5-aeb5-839aa41f3900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee487e8-fb75-41b5-aeb5-839aa41f3900', 'volume_size': 1} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:32 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 1073741824" returned: 0 in 0.585s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:32 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 Sep 30 19:55:32 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a3eb2a-08f6-4771-aac8-c13677dfab95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f458552-eae4-4f97-b9e8-0da9563869f6', 'volume_name': 'volume-7f458552-eae4-4f97-b9e8-0da9563869f6', 'volume_size': 1, 'image_id': 'f866b7cb-103b-4535-a603-edc3379ea265', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f866b7cb-103b-4535-a603-edc3379ea265', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e30b6b96ebcb8113fa7a65b8c729d076', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59006fd57a4e47648a26eeff75926778', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f896339bc67f90608b45cfe6b19bd24ce51743faa687da78b944786415f853db020ec35b6d0a639f7752fac0c183065d95185d5f4ad19850d5cc9b710e9977aa', 'id': 'f866b7cb-103b-4535-a603-edc3379ea265', 'created_at': datetime.datetime(2026, 9, 30, 17, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 55, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f866b7cb-103b-4535-a603-edc3379ea265/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eae9225-45a5-450e-b950-e1c950b0e85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eae9225-45a5-450e-b950-e1c950b0e85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb00a62a-6eeb-4d7d-bb2a-3497b13780df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Volume 7f458552-eae4-4f97-b9e8-0da9563869f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f458552-eae4-4f97-b9e8-0da9563869f6', 'volume_size': 1, 'image_id': 'f866b7cb-103b-4535-a603-edc3379ea265', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f866b7cb-103b-4535-a603-edc3379ea265', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e30b6b96ebcb8113fa7a65b8c729d076', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59006fd57a4e47648a26eeff75926778', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f896339bc67f90608b45cfe6b19bd24ce51743faa687da78b944786415f853db020ec35b6d0a639f7752fac0c183065d95185d5f4ad19850d5cc9b710e9977aa', 'id': 'f866b7cb-103b-4535-a603-edc3379ea265', 'created_at': datetime.datetime(2026, 9, 30, 17, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 55, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f866b7cb-103b-4535-a603-edc3379ea265/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Trying to clone 7f458552-eae4-4f97-b9e8-0da9563869f6 from image f866b7cb-103b-4535-a603-edc3379ea265 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f866b7cb-103b-4535-a603-edc3379ea265', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:55:32 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Image download 0.00 MB at 0.00 MB/s Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a720ca-c9dc-4fea-b86a-43e9cc0696ed]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:32 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8" returned: 0 in 0.260s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.533s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-521369890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bce91ad-0d57-4d07-a0d0-a63f4f6fb060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:29Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Creating volume 6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:32 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d90455-980f-459b-8948-65a324939ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c9d3f3-cd78-46e0-8a4a-62fe12bffa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:32 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 1073741824 Sep 30 19:55:32 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:32 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 (4e19c9ab-aad2-4884-818a-20e4928dd8b8): created successfully Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c9d3f3-cd78-46e0-8a4a-62fe12bffa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:32 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD Sep 30 19:55:32 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:32 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (3a351941-b30c-441d-9de5-29dd69aa26ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:32 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b1237e39-73b4-4e5e-b864-a4c7008360af tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created volume successfully. Sep 30 19:55:33 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-59d239dc-2e8d-43d5-a3b4-77867f309627-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-59d239dc-2e8d-43d5-a3b4-77867f309627-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:33 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD Sep 30 19:55:33 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-quobyte-59d239dc-2e8d-43d5-a3b4-77867f309627" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-59d239dc-2e8d-43d5-a3b4-77867f309627" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:33 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215dd9c-1e45-4ee8-b755-9ad20001f970]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 1073741824" returned: 0 in 0.562s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:33 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 Sep 30 19:55:33 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:33 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627 Sep 30 19:55:33 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:33 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Temporary image f866b7cb-103b-4535-a603-edc3379ea265 is fetched for user 7cdac16ad24d49cc99f91c42c62ca0dc. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3558e804-59f0-470c-b25d-a34ed5c59453]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:33 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060" returned: 0 in 0.269s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.286s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074273775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de498bb-0080-4d40-869f-0d82b05fc671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:29Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Creating volume 7de498bb-0080-4d40-869f-0d82b05fc671 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:33 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:33 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:33 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:33 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671 1073741824 Sep 30 19:55:33 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c532215-b271-41cd-9512-7064e9f075a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fafd3f5-d5c5-4676-b029-61cded0ef749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:33 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 (6bce91ad-0d57-4d07-a0d0-a63f4f6fb060): created successfully Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fafd3f5-d5c5-4676-b029-61cded0ef749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (4e7e80f0-a59c-4dc9-8b67-e641c5bf86eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:33 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:33 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-94d9a87c-fa4a-48c8-9d86-3f7e72f33797 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created volume successfully. Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627" returned: 0 in 0.449s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:33 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627 Sep 30 19:55:33 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:34 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:34 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD Sep 30 19:55:34 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:34 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-59d239dc-2e8d-43d5-a3b4-77867f309627" returned: 0 in 0.280s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-59d239dc-2e8d-43d5-a3b4-77867f309627" released by "delete_volume" :: held 0.813s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Created reservations ['5a48998a-d092-4572-b15b-9fbb94682cf9', '8c4787c6-ce07-4ceb-a85d-c1dd05b6a937', '94bd21af-655c-4075-8f81-c69b93f70ecb', 'd81e314e-5f9c-4d8f-95b0-1efc7287672b'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:34 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671 1073741824" returned: 0 in 0.552s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:34 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:34 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:34 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:34 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671 Sep 30 19:55:34 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-2e799b8f-fcae-4401-b2d5-8635d40c393b-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-2e799b8f-fcae-4401-b2d5-8635d40c393b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-quobyte-2e799b8f-fcae-4401-b2d5-8635d40c393b" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-2e799b8f-fcae-4401-b2d5-8635d40c393b" acquired by "delete_volume" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df16d85-0876-40b5-8b1a-65c10424c9fb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:34 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:34 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671" returned: 0 in 0.316s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.383s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.604s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1214242754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86216f36-0065-4097-b4d9-6036e0c2116d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:30Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Creating volume 86216f36-0065-4097-b4d9-6036e0c2116d {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:34 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:34 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Deleted volume successfully. Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ca7bf6-5d91-4aee-9b0a-8318cc3167b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de498bb-0080-4d40-869f-0d82b05fc671', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:34 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d 1073741824 Sep 30 19:55:34 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a996a3-4c50-4949-94af-b810549e63f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:34 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b Sep 30 19:55:34 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-bc416612-bbc5-417b-bbe0-aae1e03bf665 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-59d239dc-2e8d-43d5-a3b4-77867f309627-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:34 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume volume-7de498bb-0080-4d40-869f-0d82b05fc671 (7de498bb-0080-4d40-869f-0d82b05fc671): created successfully Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a996a3-4c50-4949-94af-b810549e63f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (768b12c8-6cad-491a-b88f-51b05c809d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:34 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fc70ccef-0f9a-463f-ba75-335c10fbecdf tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created volume successfully. Sep 30 19:55:35 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b" returned: 0 in 0.414s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:35 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b Sep 30 19:55:35 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:35 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d 1073741824" returned: 0 in 0.513s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:35 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d Sep 30 19:55:35 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:35 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2e799b8f-fcae-4401-b2d5-8635d40c393b" returned: 0 in 0.278s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-2e799b8f-fcae-4401-b2d5-8635d40c393b" released by "delete_volume" :: held 0.753s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Created reservations ['4c79a166-dea4-472c-885e-c3e271624e23', '2e3372f5-8e68-419a-a96c-45fd209d1de0', '1bd94c22-394c-46ff-a722-37b55a757b0b', '4ca234e9-2a63-4fa9-b464-889d35601810'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:35 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:35 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:35 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.083s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502001216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc288c5-7763-4778-a595-8d8c70e54a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1eb3337f5c348b5b0ca77443d195579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:30Z,use_quota=True,user_id='403e020bd9da433c88135d62b260b2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Creating volume cdc288c5-7763-4778-a595-8d8c70e54a4a {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:35 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:35 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a 1073741824 Sep 30 19:55:35 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039aac7a-3482-420a-aa6f-7169a77de78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86216f36-0065-4097-b4d9-6036e0c2116d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eb98a3-9589-4dd9-a9dc-48c3895701ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:35 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume volume-86216f36-0065-4097-b4d9-6036e0c2116d (86216f36-0065-4097-b4d9-6036e0c2116d): created successfully Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eb98a3-9589-4dd9-a9dc-48c3895701ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (b9b33778-e19b-4936-8a54-6e579bbefe0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:35 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-bc2101dc-f53a-4bcf-84e9-61ec20aa60ce tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created volume successfully. Sep 30 19:55:35 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.282s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:35 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Deleted volume successfully. Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-db7e6d82-cb82-4fb5-8157-701566c913c7 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-2e799b8f-fcae-4401-b2d5-8635d40c393b-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-quobyte-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[57019cf7-dfe5-4428-b9b2-5f3576eed04a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:36 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da Sep 30 19:55:36 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:36 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a 1073741824" returned: 0 in 0.492s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:36 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a Sep 30 19:55:36 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:36 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da" returned: 0 in 0.393s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:36 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da Sep 30 19:55:36 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:36 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a" returned: 0 in 0.275s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.837s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1196410250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee487e8-fb75-41b5-aeb5-839aa41f3900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:32Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Creating volume eee487e8-fb75-41b5-aeb5-839aa41f3900 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:36 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4186e9-ac1c-444a-9a94-7cb37118dc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc288c5-7763-4778-a595-8d8c70e54a4a', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:36 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 1073741824 Sep 30 19:55:36 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c051178-d607-4da5-9ae9-ed0e2124a72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:36 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Volume volume-cdc288c5-7763-4778-a595-8d8c70e54a4a (cdc288c5-7763-4778-a595-8d8c70e54a4a): created successfully Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c051178-d607-4da5-9ae9-ed0e2124a72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Flow 'volume_create_manager' (75ebf266-f851-4c09-8040-4f5a86a6cce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:36 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ca03d94c-9dc7-4a3b-9fd8-b7f1dc2f2017 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created volume successfully. Sep 30 19:55:36 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da" returned: 0 in 0.273s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da" released by "delete_volume" :: held 0.712s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Created reservations ['bd8c5968-c340-4db8-b3cc-fa7a87e9592d', '1cd43ec9-85e1-4084-832e-c542e2c67a8f', '202dae7b-6b01-4b69-954c-fbd10998f064', 'fbec3d02-4dcd-44df-a265-31c804a140de'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:36 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:36 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:36 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 1073741824" returned: 0 in 0.467s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:36 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 Sep 30 19:55:36 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:37 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.311s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:37 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Deleted volume successfully. Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-quobyte-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-74d75a82-a2f1-4547-bd12-fba8e638b395 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-dfcb1da4-a3df-4bf3-b4a5-456dbf6617da-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c86ee1-49a2-42df-a212-1e4e2c7d3fda]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-cdc288c5-7763-4778-a595-8d8c70e54a4a-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-cdc288c5-7763-4778-a595-8d8c70e54a4a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-quobyte-cdc288c5-7763-4778-a595-8d8c70e54a4a" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-cdc288c5-7763-4778-a595-8d8c70e54a4a" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[74794a5a-870e-4922-8f8d-513d5819fc22]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:37 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 Sep 30 19:55:37 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:37 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900" returned: 0 in 0.379s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.898s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f458552-eae4-4f97-b9e8-0da9563869f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59006fd57a4e47648a26eeff75926778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:32Z,use_quota=True,user_id='7cdac16ad24d49cc99f91c42c62ca0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d5b4ea-7d36-4eaf-a23b-3a5ca52d1889),volume_type_id=81d5b4ea-7d36-4eaf-a23b-3a5ca52d1889)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Creating volume 7f458552-eae4-4f97-b9e8-0da9563869f6 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:37 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5330f92f-88de-4fcc-804c-50061e5b2ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee487e8-fb75-41b5-aeb5-839aa41f3900', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c25a214-54dc-470b-9b66-790cb0aa6d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:37 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 1073741824 Sep 30 19:55:37 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:37 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Volume volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 (eee487e8-fb75-41b5-aeb5-839aa41f3900): created successfully Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c25a214-54dc-470b-9b66-790cb0aa6d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (67f2bdce-c06f-4b2d-a6c8-bf420ab1da2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:37 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-778ca7ea-8a43-41be-b8c2-302a842f4120 tempest-ProjectReaderTests-576119329 None] Created volume successfully. Sep 30 19:55:37 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a Sep 30 19:55:37 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:37 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0" returned: 0 in 0.439s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:37 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0 Sep 30 19:55:37 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:37 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a" returned: 0 in 0.414s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:37 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a Sep 30 19:55:37 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:37 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0" returned: 0 in 0.284s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0" released by "delete_volume" :: held 0.784s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:37 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 1073741824" returned: 0 in 0.561s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:37 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 Sep 30 19:55:37 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:37 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Created reservations ['20ff72fb-e691-47a5-96f4-b3040d5f9814', 'b2ccca1d-e8db-45d1-9a4c-3083fd995f40', 'd4f81225-a123-493b-8f20-a75e926ffc89', 'f939077e-666b-44a0-a82b-d8dcd91e3530'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:38 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-cdc288c5-7763-4778-a595-8d8c70e54a4a" returned: 0 in 0.319s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-cdc288c5-7763-4778-a595-8d8c70e54a4a" released by "delete_volume" :: held 0.817s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created reservations ['396406f4-f1ed-4b47-ba91-569afead2d92', 'b92d5c19-8673-442f-9985-f0f3dced10bd', 'a526bccf-2fac-4834-a41a-d471c2529cca', 'd019ba17-f7ed-4528-9c28-2289d7f21835'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:38 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:38 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-79258497-7b41-428a-8d82-8f4acdb2507e-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-79258497-7b41-428a-8d82-8f4acdb2507e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:38 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6" returned: 0 in 0.319s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.180s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "cinder-quobyte-79258497-7b41-428a-8d82-8f4acdb2507e" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-86216f36-0065-4097-b4d9-6036e0c2116d-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-79258497-7b41-428a-8d82-8f4acdb2507e" acquired by "delete_volume" :: waited 0.047s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-86216f36-0065-4097-b4d9-6036e0c2116d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Attempting download of f866b7cb-103b-4535-a603-edc3379ea265 ((None, [{'url': 'file:///opt/stack/data/glance/images/f866b7cb-103b-4535-a603-edc3379ea265', 'metadata': {}}])) to volume 7f458552-eae4-4f97-b9e8-0da9563869f6. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a949dc61-cb6d-4a1d-a26b-fa56545c0599]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Creating offline snapshot c586270f-11eb-4244-a4ee-b20e9ce820ca of volume eee487e8-fb75-41b5-aeb5-839aa41f3900 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[84acead0-2574-49c4-a038-355cd792ae0c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:38 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:38 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9892bbda-1402-4fc0-a896-9f55b7a4c3ad]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f866b7cb-103b-4535-a603-edc3379ea265_8dgpzamo {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:38 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-quobyte-86216f36-0065-4097-b4d9-6036e0c2116d" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.424s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:38 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Deleted volume successfully. Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-86216f36-0065-4097-b4d9-6036e0c2116d" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:38 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e Sep 30 19:55:38 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f8747a16-8d41-4aca-aa47-a33077670bd2 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-d4510ec0-f85c-4ddf-bc26-475ce6b43cb0-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d8d68-7f66-4ff4-90c1-b2f2e3ac7ba1]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:38 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 Sep 30 19:55:38 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:38 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f866b7cb-103b-4535-a603-edc3379ea265_8dgpzamo Sep 30 19:55:38 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:38 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d Sep 30 19:55:38 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:38 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.422s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:38 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Deleted volume successfully. Sep 30 19:55:38 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e" returned: 0 in 0.490s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:38 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e Sep 30 19:55:38 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e9fcdccd-09b6-4bce-8633-907a8d32a6bb tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-cdc288c5-7763-4778-a595-8d8c70e54a4a-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:39 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900" returned: 0 in 0.595s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:39 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f866b7cb-103b-4535-a603-edc3379ea265_8dgpzamo" returned: 0 in 0.552s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f866b7cb-103b-4535-a603-edc3379ea265_8dgpzamo {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d" returned: 0 in 0.471s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca 1G Sep 30 19:55:39 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:39 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d Sep 30 19:55:39 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:39 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f866b7cb-103b-4535-a603-edc3379ea265_8dgpzamo Sep 30 19:55:39 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:39 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-79258497-7b41-428a-8d82-8f4acdb2507e" returned: 0 in 0.314s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-quobyte-79258497-7b41-428a-8d82-8f4acdb2507e" released by "delete_volume" :: held 0.882s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Created reservations ['43ddb9c8-afc0-4bb8-b411-8ff9515e0d5f', '3cc7c6cb-ee2d-4366-b7e0-0731b80af8e8', '621e0f23-6a2d-4eec-8a75-5d9efd78ab35', '3a1c112d-2f8f-453d-9e62-498a85d37375'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:39 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-86216f36-0065-4097-b4d9-6036e0c2116d" returned: 0 in 0.316s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:39 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-86216f36-0065-4097-b4d9-6036e0c2116d" released by "delete_volume" :: held 0.869s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created reservations ['067adcd7-1fa9-47c6-9ddc-8f4be7dc54fa', '11a8a194-042a-4029-9a08-d79eef90ad02', '4b5cf008-1da1-4b13-b7e7-30c777662645', '73dfde2f-0fd9-439b-85b5-2fb787987875'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:39 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f866b7cb-103b-4535-a603-edc3379ea265_8dgpzamo" returned: 1 in 0.472s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f866b7cb-103b-4535-a603-edc3379ea265_8dgpzamo' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dccd766-8c77-4843-8c3c-b4f4f9fe0a7f]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:39 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca 1G" returned: 0 in 0.600s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:39 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:39 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:39 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD Sep 30 19:55:39 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca Sep 30 19:55:39 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:39 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:39 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.332s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Deleted volume successfully. Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5e9dec47-7241-4962-a047-b62bc027f6a5 tempest-CreateVolumesFromImageTest-1340733447 None] Lock "cinder-79258497-7b41-428a-8d82-8f4acdb2507e-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:39 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:39 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.304s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:39 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Deleted volume successfully. Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca" returned: 0 in 0.306s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:39 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca is being set with open permissions: ugo+rw Sep 30 19:55:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-49c36fbd-1411-491a-9e54-5015ae7d3727 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-86216f36-0065-4097-b4d9-6036e0c2116d-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:40 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca Sep 30 19:55:40 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:40 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD Sep 30 19:55:40 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:40 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca" returned: 0 in 0.260s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:40 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] f866b7cb-103b-4535-a603-edc3379ea265 was raw, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:55:40 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.info Sep 30 19:55:40 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:40 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 Sep 30 19:55:40 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:40 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.info" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:40 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.info is being set with open permissions: ugo+rw Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:40 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.info Sep 30 19:55:40 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-7de498bb-0080-4d40-869f-0d82b05fc671-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-7de498bb-0080-4d40-869f-0d82b05fc671-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-quobyte-7de498bb-0080-4d40-869f-0d82b05fc671" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-7de498bb-0080-4d40-869f-0d82b05fc671" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d04a5-cd6d-4f33-83bf-60ad80c57e9d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:40 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.info" returned: 0 in 0.311s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:40 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6" returned: 0 in 0.601s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f866b7cb-103b-4535-a603-edc3379ea265_ssye_azedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:55:40 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 19:55:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:40 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 1G Sep 30 19:55:40 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:40 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671 Sep 30 19:55:40 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:40 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f060ef14-2c60-4d8c-9853-21eaebf3d630 tempest-ProjectReaderTests-576119329 None] Create snapshot completed successfully Sep 30 19:55:41 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671" returned: 0 in 0.433s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:41 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671 Sep 30 19:55:41 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:41 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 1G" returned: 0 in 0.391s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Downloaded image f866b7cb-103b-4535-a603-edc3379ea265 ((None, [{'url': 'file:///opt/stack/data/glance/images/f866b7cb-103b-4535-a603-edc3379ea265', 'metadata': {}}])) to volume 7f458552-eae4-4f97-b9e8-0da9563869f6 successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Temporary image f866b7cb-103b-4535-a603-edc3379ea265 for user 7cdac16ad24d49cc99f91c42c62ca0dc is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Marking volume 7f458552-eae4-4f97-b9e8-0da9563869f6 as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Copying metadata from image f866b7cb-103b-4535-a603-edc3379ea265 to 7f458552-eae4-4f97-b9e8-0da9563869f6. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Creating volume glance metadata for volume 7f458552-eae4-4f97-b9e8-0da9563869f6 backed by image f866b7cb-103b-4535-a603-edc3379ea265 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f866b7cb-103b-4535-a603-edc3379ea265', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e30b6b96ebcb8113fa7a65b8c729d076', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb00a62a-6eeb-4d7d-bb2a-3497b13780df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f458552-eae4-4f97-b9e8-0da9563869f6', 'volume_size': 1, 'image_id': 'f866b7cb-103b-4535-a603-edc3379ea265', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f866b7cb-103b-4535-a603-edc3379ea265', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e30b6b96ebcb8113fa7a65b8c729d076', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59006fd57a4e47648a26eeff75926778', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f896339bc67f90608b45cfe6b19bd24ce51743faa687da78b944786415f853db020ec35b6d0a639f7752fac0c183065d95185d5f4ad19850d5cc9b710e9977aa', 'id': 'f866b7cb-103b-4535-a603-edc3379ea265', 'created_at': datetime.datetime(2026, 9, 30, 17, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 55, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f866b7cb-103b-4535-a603-edc3379ea265/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d7938e-19d8-4522-94ba-372b7d77de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:41 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Volume volume-7f458552-eae4-4f97-b9e8-0da9563869f6 (7f458552-eae4-4f97-b9e8-0da9563869f6): created successfully Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d7938e-19d8-4522-94ba-372b7d77de82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Flow 'volume_create_manager' (74ce2522-8400-4ac3-ae18-972cb4811fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:41 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a3e595f1-b510-4399-9336-d55b41334b14 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Created volume successfully. Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-c586270f-11eb-4244-a4ee-b20e9ce820ca-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:41 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-c586270f-11eb-4244-a4ee-b20e9ce820ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-eee487e8-fb75-41b5-aeb5-839aa41f3900" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7de498bb-0080-4d40-869f-0d82b05fc671" returned: 0 in 0.385s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-7de498bb-0080-4d40-869f-0d82b05fc671" released by "delete_volume" :: held 0.865s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-eee487e8-fb75-41b5-aeb5-839aa41f3900" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-c586270f-11eb-4244-a4ee-b20e9ce820ca" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-c586270f-11eb-4244-a4ee-b20e9ce820ca" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Deleting offline snapshot c586270f-11eb-4244-a4ee-b20e9ce820ca of volume eee487e8-fb75-41b5-aeb5-839aa41f3900 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] snapshot_file for this snap is: volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260be20-f422-4866-9e7d-7281fba66ebe]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Acquiring lock "cinder-7f458552-eae4-4f97-b9e8-0da9563869f6-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "cinder-7f458552-eae4-4f97-b9e8-0da9563869f6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created reservations ['5650d735-bf32-4ed2-af76-5930b451be08', '8b7bb236-a393-4bcd-9201-a9ca1b7fd14a', 'cd8460a9-ef4b-4968-98d4-66d3d8350fe6', '684f5cca-8523-4990-8d68-0affa1890c02'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Acquiring lock "cinder-quobyte-7f458552-eae4-4f97-b9e8-0da9563869f6" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:41 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca Sep 30 19:55:41 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "cinder-quobyte-7f458552-eae4-4f97-b9e8-0da9563869f6" acquired by "delete_volume" :: waited 0.058s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:41 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:41 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f357118-407a-4e5e-b4a1-e60d7a58c4d9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:42 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 Sep 30 19:55:42 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:42 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca" returned: 0 in 0.513s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eee487e8-fb75-41b5-aeb5-839aa41f3900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[176ed305-0e4c-4406-95e6-370d87dac355]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:42 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.397s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Deleted volume successfully. Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d4f3d783-4c59-42fd-8b62-23f181f4037d tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-7de498bb-0080-4d40-869f-0d82b05fc671-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:42 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 Sep 30 19:55:42 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:42 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6" returned: 0 in 0.499s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:42 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6 Sep 30 19:55:42 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:42 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900" returned: 0 in 0.428s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:42 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca Sep 30 19:55:42 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:42 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f458552-eae4-4f97-b9e8-0da9563869f6" returned: 0 in 0.284s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "cinder-quobyte-7f458552-eae4-4f97-b9e8-0da9563869f6" released by "delete_volume" :: held 0.851s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Created reservations ['2df3be80-711d-42ad-8eb7-2233251b6acb', 'bb7eece9-0e38-4547-8007-c513954d83b9', 'cdf3b09c-46b3-404b-b75e-edd28b827ed1', 'd8c8401b-a66b-496e-8ff4-54640026a330'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:43 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:43 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-quobyte-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[488b19a4-0217-4baa-ba18-7a0615ab55df]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:43 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca" returned: 0 in 0.531s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:43 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca Sep 30 19:55:43 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:43 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.406s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:43 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 Sep 30 19:55:43 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:43 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Deleted volume successfully. Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-32425866-7eb7-423d-a333-1b9966a96233 tempest-VolumeAndVolumeTypeFromImageTest-1990273634 None] Lock "cinder-7f458552-eae4-4f97-b9e8-0da9563869f6-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:43 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900.c586270f-11eb-4244-a4ee-b20e9ce820ca" returned: 0 in 0.369s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-c586270f-11eb-4244-a4ee-b20e9ce820ca" released by "_delete_snapshot" :: held 2.015s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:43 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060" returned: 0 in 0.471s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-eee487e8-fb75-41b5-aeb5-839aa41f3900" released by "delete_snapshot" :: held 2.066s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:43 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060 Sep 30 19:55:43 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Created reservations ['50242ac9-bf69-47b2-9817-72d9f6087ccb', '889a109f-7248-40dc-8674-bf369d046fe5', '94c7f3eb-d766-48bf-97ab-c1d39ff82455', '540ae781-002d-45c4-a3dd-f466d9d6735a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:43 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Delete snapshot completed successfully. Sep 30 19:55:43 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5d1550d2-705e-4311-bcbe-c5946c0b59f9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-c586270f-11eb-4244-a4ee-b20e9ce820ca-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:44 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060" returned: 0 in 0.299s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060" released by "delete_volume" :: held 0.841s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created reservations ['7cc9f18a-a69c-47ff-a9b4-28c73465bd60', 'a62c9cc9-6475-470f-a8ce-226c84fa457a', 'c323a0ad-b68d-48b6-9b6a-249f03742312', '5b6a4dfc-021d-46a7-a0fd-3556d5985074'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:44 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:44 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:44 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.259s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:44 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Deleted volume successfully. Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2600caf4-40c7-42c0-8267-4096e3681832 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-6bce91ad-0d57-4d07-a0d0-a63f4f6fb060-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-4e19c9ab-aad2-4884-818a-20e4928dd8b8-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-4e19c9ab-aad2-4884-818a-20e4928dd8b8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-quobyte-4e19c9ab-aad2-4884-818a-20e4928dd8b8" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-4e19c9ab-aad2-4884-818a-20e4928dd8b8" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90223a2-2000-41d7-80c0-00b731c71f3d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-eee487e8-fb75-41b5-aeb5-839aa41f3900-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (2d0b658f-113a-45c5-9d96-6cfe635b1990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16d4bb3-6615-43f3-b0c7-67ab48e4263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Lock "cinder-eee487e8-fb75-41b5-aeb5-839aa41f3900-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16d4bb3-6615-43f3-b0c7-67ab48e4263a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087866174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89721376-0ac9-4d25-a203-1c5d9cfef823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:45Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0f3b6f-7366-4f9e-b21f-93a79e2196a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0f3b6f-7366-4f9e-b21f-93a79e2196a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74dfadc-d461-409c-967c-998c00558b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74dfadc-d461-409c-967c-998c00558b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89721376-0ac9-4d25-a203-1c5d9cfef823', 'volume_name': 'volume-89721376-0ac9-4d25-a203-1c5d9cfef823', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae4bd42-8ec7-4cdf-86bc-4bbf0c7af77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:44 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 Sep 30 19:55:44 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae4bd42-8ec7-4cdf-86bc-4bbf0c7af77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b687c564-5abf-41a0-8507-5a6fd79b4a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:44 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume 89721376-0ac9-4d25-a203-1c5d9cfef823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89721376-0ac9-4d25-a203-1c5d9cfef823', 'volume_size': 1} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087866174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89721376-0ac9-4d25-a203-1c5d9cfef823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:45Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Creating volume 89721376-0ac9-4d25-a203-1c5d9cfef823 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:45 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:45 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 1073741824 Sep 30 19:55:45 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-eee487e8-fb75-41b5-aeb5-839aa41f3900" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-eee487e8-fb75-41b5-aeb5-839aa41f3900" acquired by "delete_volume" :: waited 0.032s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fd82dc-6372-436e-a995-b6dcfc00b34c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:45 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 Sep 30 19:55:45 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:45 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8" returned: 0 in 0.475s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:45 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8 Sep 30 19:55:45 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:45 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 1073741824" returned: 0 in 0.566s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:45 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900" returned: 0 in 0.465s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:45 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900 Sep 30 19:55:45 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:45 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4e19c9ab-aad2-4884-818a-20e4928dd8b8" returned: 0 in 0.351s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:45 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 Sep 30 19:55:45 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-4e19c9ab-aad2-4884-818a-20e4928dd8b8" released by "delete_volume" :: held 0.928s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created reservations ['2aa33c18-a477-4eb9-bccc-5fb6df5af697', '1df83ffb-8b18-4f4a-8819-2993097c27ce', '33247006-f23b-4bce-a48e-757f7d789f61', 'a33dd823-6d47-465c-be52-7ad046b9681d'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:45 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-eee487e8-fb75-41b5-aeb5-839aa41f3900" returned: 0 in 0.387s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823" returned: 0 in 0.371s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b687c564-5abf-41a0-8507-5a6fd79b4a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89721376-0ac9-4d25-a203-1c5d9cfef823', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed37e643-37f4-4de4-917f-6f16424f16ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-eee487e8-fb75-41b5-aeb5-839aa41f3900" released by "delete_volume" :: held 0.982s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:45 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:46 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume volume-89721376-0ac9-4d25-a203-1c5d9cfef823 (89721376-0ac9-4d25-a203-1c5d9cfef823): created successfully Sep 30 19:55:45 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:45 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:45 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed37e643-37f4-4de4-917f-6f16424f16ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (2d0b658f-113a-45c5-9d96-6cfe635b1990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:46 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6a25c73c-63f9-43c7-b535-a3c0d6fd00ad tempest-CreateVolumesFromSnapshotTest-439052887 None] Created volume successfully. Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Created reservations ['d2246d26-2ee3-4997-b753-7c75dee3ccc9', '4ecb4975-8751-488f-9fdc-92be42b8eb6c', '911a8ecf-8f54-46dc-a65a-2e34df05a1fb', '79149f4c-4e51-427a-9e14-7fd86b1fe71f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:46 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.417s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:46 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:46 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:46 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Deleted volume successfully. Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fe359e89-8ad5-49aa-be70-40d4a96f8c24 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-4e19c9ab-aad2-4884-818a-20e4928dd8b8-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:46 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:46 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Deleted volume successfully. Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c896da43-57e3-4271-9282-0c502411bfcc tempest-ProjectReaderTests-576119329 None] Lock "cinder-eee487e8-fb75-41b5-aeb5-839aa41f3900-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-7fa27373-6822-470f-bc72-c8cf5d18fdf0-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-7fa27373-6822-470f-bc72-c8cf5d18fdf0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "cinder-quobyte-7fa27373-6822-470f-bc72-c8cf5d18fdf0" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-7fa27373-6822-470f-bc72-c8cf5d18fdf0" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea5382c-ed3f-4907-a769-a8e7a0034eaa]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:47 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 Sep 30 19:55:47 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Creating offline snapshot 61fd0cc9-22c4-464a-8ad8-924aa5e8c18a of volume 89721376-0ac9-4d25-a203-1c5d9cfef823 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39928cb-3bb1-46ac-b9e9-39878ae9f835]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:47 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 Sep 30 19:55:47 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:47 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0" returned: 0 in 0.476s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:47 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0 Sep 30 19:55:47 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:47 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (64acfdff-9ea0-458c-8f1f-7994fa10f69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2c1886-8553-45b2-9c3a-4b4a5ce939d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823" returned: 0 in 0.543s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2c1886-8553-45b2-9c3a-4b4a5ce939d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323238097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d5ac30-4eb2-4434-a68c-96a28a60c43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:48Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70d6812-e08a-45b5-82ef-ae6de5b54dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70d6812-e08a-45b5-82ef-ae6de5b54dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:47 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a 1G Sep 30 19:55:47 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10ad860-dd76-4b9a-aa57-0392a668be3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10ad860-dd76-4b9a-aa57-0392a668be3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d5ac30-4eb2-4434-a68c-96a28a60c43c', 'volume_name': 'volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:47 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ff2146-e646-40d5-a312-c5a416c5f2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ff2146-e646-40d5-a312-c5a416c5f2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84c69d8-4383-481c-a2a1-e6188683ee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:47 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Volume 18d5ac30-4eb2-4434-a68c-96a28a60c43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c', 'volume_size': 1} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7fa27373-6822-470f-bc72-c8cf5d18fdf0" returned: 0 in 0.367s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-quobyte-7fa27373-6822-470f-bc72-c8cf5d18fdf0" released by "delete_volume" :: held 0.907s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:47 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Created reservations ['0f9ac9b2-1fd4-435e-8b72-69b01a8e3407', 'e1fe8779-1f7d-49a3-91de-a381bbddc8ff', '184c91d0-97d9-41f1-993d-5189536442c4', 'fb902dc7-2c5b-4d01-8289-c8fc0283fb2f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:48 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:55:48 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:48 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:48 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.310s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a 1G" returned: 0 in 0.556s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89721376-0ac9-4d25-a203-1c5d9cfef823 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Deleted volume successfully. Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6424bf28-5280-43cd-bc93-abbd67145cb3 tempest-CreateVolumesFromSourceVolumeTest-1857413820 None] Lock "cinder-7fa27373-6822-470f-bc72-c8cf5d18fdf0-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:48 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89721376-0ac9-4d25-a203-1c5d9cfef823 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a Sep 30 19:55:48 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:48 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89721376-0ac9-4d25-a203-1c5d9cfef823 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a" returned: 0 in 0.325s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:48 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a is being set with open permissions: ugo+rw Sep 30 19:55:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:48 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a Sep 30 19:55:48 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:49 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a" returned: 0 in 0.297s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:49 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.info Sep 30 19:55:49 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:49 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.info" returned: 0 in 0.269s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:49 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.info is being set with open permissions: ugo+rw Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:49 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.info Sep 30 19:55:49 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:49 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.info" returned: 0 in 0.294s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.744s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323238097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d5ac30-4eb2-4434-a68c-96a28a60c43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:48Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Creating volume 18d5ac30-4eb2-4434-a68c-96a28a60c43c {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:49 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:49 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c 1073741824 Sep 30 19:55:49 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:49 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-155ee641-1d83-42f2-8879-88ffed536982 tempest-CreateVolumesFromSnapshotTest-439052887 None] Create snapshot completed successfully Sep 30 19:55:50 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c 1073741824" returned: 0 in 0.536s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:50 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c Sep 30 19:55:50 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:50 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c" returned: 0 in 0.278s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84c69d8-4383-481c-a2a1-e6188683ee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253e2fd1-62c4-4fac-af31-5719640a9c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:50 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Volume volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c (18d5ac30-4eb2-4434-a68c-96a28a60c43c): created successfully Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253e2fd1-62c4-4fac-af31-5719640a9c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (64acfdff-9ea0-458c-8f1f-7994fa10f69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:50 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-06d4ac75-21cc-4551-a61a-43546a643cfb tempest-ProjectReaderTests-576119329 None] Created volume successfully. Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (954121e9-8782-42e1-b853-3dc073d288c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3d4b79-ff7e-4aa1-8acb-bb6ddc2e840f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3d4b79-ff7e-4aa1-8acb-bb6ddc2e840f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730948816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416d18f0-03f3-476f-b530-0734ec0bfb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:51Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff7c505-c63d-468e-b8fd-dc336e64c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff7c505-c63d-468e-b8fd-dc336e64c682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeecfa8e-9c83-4017-8783-9047e70be964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeecfa8e-9c83-4017-8783-9047e70be964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416d18f0-03f3-476f-b530-0734ec0bfb69', 'volume_name': 'volume-416d18f0-03f3-476f-b530-0734ec0bfb69', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42967d9b-c5af-4371-9f25-3400afaf439f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42967d9b-c5af-4371-9f25-3400afaf439f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84481f78-f445-44c6-98cd-d4b39a9463e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:50 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume 416d18f0-03f3-476f-b530-0734ec0bfb69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416d18f0-03f3-476f-b530-0734ec0bfb69', 'volume_size': 1} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730948816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416d18f0-03f3-476f-b530-0734ec0bfb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:51Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Creating volume 416d18f0-03f3-476f-b530-0734ec0bfb69 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:50 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:51 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69 1073741824 Sep 30 19:55:51 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (e1ed3f9c-9fdb-4a09-a262-c157e1f385f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2feec21-887d-45d2-8c90-f1b3094035ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2feec21-887d-45d2-8c90-f1b3094035ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215417334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64186782-6b84-4238-aafa-af3984156f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:51Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e2cede-713c-4a5f-9ca4-4ac02115e895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e2cede-713c-4a5f-9ca4-4ac02115e895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa05efd-37d2-47aa-b01f-8fe846225814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa05efd-37d2-47aa-b01f-8fe846225814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64186782-6b84-4238-aafa-af3984156f69', 'volume_name': 'volume-64186782-6b84-4238-aafa-af3984156f69', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae133e9-9182-4164-ab83-f8ffce3172c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae133e9-9182-4164-ab83-f8ffce3172c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bdeb54-b258-43f4-9f5c-18a96935dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume 64186782-6b84-4238-aafa-af3984156f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64186782-6b84-4238-aafa-af3984156f69', 'volume_size': 1} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:51 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69 1073741824" returned: 0 in 0.692s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:51 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69 Sep 30 19:55:51 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Flow 'volume_create_manager' (edbad9dd-5904-4cb6-b73a-3436e7c0fd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2437033d-ec85-430e-a736-43fda7f52a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2437033d-ec85-430e-a736-43fda7f52a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1375332593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7efa11-0da9-4040-bb7b-7728916f6d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7477db253495407e922b92000f912782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:52Z,use_quota=True,user_id='28ec68d56d9f4234919e9fe72664a5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0fc8a7-a66c-4155-b982-3107bdc258b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0fc8a7-a66c-4155-b982-3107bdc258b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e124762-514b-4e7b-98b0-e0fce886a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e124762-514b-4e7b-98b0-e0fce886a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7efa11-0da9-4040-bb7b-7728916f6d30', 'volume_name': 'volume-6e7efa11-0da9-4040-bb7b-7728916f6d30', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1a0a07-d7ba-44f6-953f-ec5d5803f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1a0a07-d7ba-44f6-953f-ec5d5803f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae82a1b7-7b2a-4eb4-8b6f-aaa922b9d442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:51 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Volume 6e7efa11-0da9-4040-bb7b-7728916f6d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7efa11-0da9-4040-bb7b-7728916f6d30', 'volume_size': 1} Sep 30 19:55:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:52 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69" returned: 0 in 0.334s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215417334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64186782-6b84-4238-aafa-af3984156f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:51Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Creating volume 64186782-6b84-4238-aafa-af3984156f69 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:52 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84481f78-f445-44c6-98cd-d4b39a9463e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416d18f0-03f3-476f-b530-0734ec0bfb69', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69 1073741824 Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d9d1a8-72d3-4bb7-9234-064df6ebed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (c98550fe-4b94-4f39-a19c-b126c50713bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29f3b35-ee8b-40fd-b056-2227632a6953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume volume-416d18f0-03f3-476f-b530-0734ec0bfb69 (416d18f0-03f3-476f-b530-0734ec0bfb69): created successfully Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d9d1a8-72d3-4bb7-9234-064df6ebed51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (954121e9-8782-42e1-b853-3dc073d288c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29f3b35-ee8b-40fd-b056-2227632a6953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1487537257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6bcdde-9e78-42bf-bace-feac6df3f968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:52Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e9b080-75e7-46f7-85de-86217da9a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e9b080-75e7-46f7-85de-86217da9a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57c3b89-7279-44fa-be73-2b8e7d87aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57c3b89-7279-44fa-be73-2b8e7d87aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f6bcdde-9e78-42bf-bace-feac6df3f968', 'volume_name': 'volume-3f6bcdde-9e78-42bf-bace-feac6df3f968', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ebae9c-1209-4d05-a971-6504943939d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ebae9c-1209-4d05-a971-6504943939d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6850a379-628e-4697-9d71-aa1ce863cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume 3f6bcdde-9e78-42bf-bace-feac6df3f968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f6bcdde-9e78-42bf-bace-feac6df3f968', 'volume_size': 1} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1968690c-043f-40f6-abae-44b4a9ac3fca tempest-CreateVolumesFromSnapshotTest-439052887 None] Created volume successfully. Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (f327ffe2-433c-4573-affb-052f2e06b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04344f9d-e316-4065-901e-06cbb3493a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04344f9d-e316-4065-901e-06cbb3493a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-932872598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abd7eaa-6f78-4217-85f3-8c90c99b89af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:52Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c6d6e4-3f9f-4e2d-89b1-d0cdc53e14d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c6d6e4-3f9f-4e2d-89b1-d0cdc53e14d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cfd6c6-ceea-43d3-bb13-bd2f83b64883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cfd6c6-ceea-43d3-bb13-bd2f83b64883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6abd7eaa-6f78-4217-85f3-8c90c99b89af', 'volume_name': 'volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab42d2b7-9a9c-49ad-8115-9d56d8e341c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab42d2b7-9a9c-49ad-8115-9d56d8e341c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa02a18a-c15c-4f03-ad77-cd3db286b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:52 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume 6abd7eaa-6f78-4217-85f3-8c90c99b89af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af', 'volume_size': 1} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:52 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69 1073741824" returned: 0 in 0.651s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:52 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69 Sep 30 19:55:52 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:53 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69" returned: 0 in 0.279s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.090s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1375332593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7efa11-0da9-4040-bb7b-7728916f6d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7477db253495407e922b92000f912782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:52Z,use_quota=True,user_id='28ec68d56d9f4234919e9fe72664a5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Creating volume 6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:53 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bdeb54-b258-43f4-9f5c-18a96935dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64186782-6b84-4238-aafa-af3984156f69', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:53 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 1073741824 Sep 30 19:55:53 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980d2b7d-c997-4770-986b-9aefc385ed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (2d484e74-670f-4590-8249-ffe09b7d9552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424bf3fc-abf7-46d8-b84f-0fbe46126c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume volume-64186782-6b84-4238-aafa-af3984156f69 (64186782-6b84-4238-aafa-af3984156f69): created successfully Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980d2b7d-c997-4770-986b-9aefc385ed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (e1ed3f9c-9fdb-4a09-a262-c157e1f385f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424bf3fc-abf7-46d8-b84f-0fbe46126c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143843786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa14c0d-3696-4637-8e4a-d7bbf5b4b773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:53Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584002d2-ecc5-4670-899b-592e0e3e4378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584002d2-ecc5-4670-899b-592e0e3e4378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd659dc6-2e7c-470b-9f8a-b19f9144137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd659dc6-2e7c-470b-9f8a-b19f9144137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa14c0d-3696-4637-8e4a-d7bbf5b4b773', 'volume_name': 'volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44fb065-d864-4938-a264-145009f19ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44fb065-d864-4938-a264-145009f19ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf46e66-0bb5-435b-bcea-e58d479eb593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume ffa14c0d-3696-4637-8e4a-d7bbf5b4b773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773', 'volume_size': 1} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-769cf2b7-8cce-4016-9660-092e90be9492 tempest-CreateVolumesFromSnapshotTest-439052887 None] Created volume successfully. Sep 30 19:55:53 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 1073741824" returned: 0 in 0.436s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:53 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 Sep 30 19:55:53 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:53 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30" returned: 0 in 0.256s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.785s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Creating offline snapshot 4bd0f290-dbfa-46de-bc3d-eca35e6bc451 of volume 18d5ac30-4eb2-4434-a68c-96a28a60c43c {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae82a1b7-7b2a-4eb4-8b6f-aaa922b9d442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7efa11-0da9-4040-bb7b-7728916f6d30', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504cb6ea-4c4d-421b-b77a-d0e869cabb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[265841ec-d7a6-4eb7-b6ae-d76c8c5360de]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Volume volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 (6e7efa11-0da9-4040-bb7b-7728916f6d30): created successfully Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504cb6ea-4c4d-421b-b77a-d0e869cabb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Flow 'volume_create_manager' (edbad9dd-5904-4cb6-b73a-3436e7c0fd59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-cfd3aed9-5020-4352-9d7f-f36e48d240be tempest-VolumeDependencyTests-1330950564 None] Created volume successfully. Sep 30 19:55:53 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c Sep 30 19:55:53 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:54 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c" returned: 0 in 0.404s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:54 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 1G Sep 30 19:55:54 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:54 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 1G" returned: 0 in 0.458s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:54 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 Sep 30 19:55:54 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:55 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451" returned: 0 in 0.333s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:55 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 is being set with open permissions: ugo+rw Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:55 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 Sep 30 19:55:55 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:55 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451" returned: 0 in 0.283s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:55 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.info Sep 30 19:55:55 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:55 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.info" returned: 0 in 0.250s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:55 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.info is being set with open permissions: ugo+rw Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:55 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.info Sep 30 19:55:55 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:55 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.info" returned: 0 in 0.254s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.599s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1487537257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6bcdde-9e78-42bf-bace-feac6df3f968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:52Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Creating volume 3f6bcdde-9e78-42bf-bace-feac6df3f968 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:55 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:55 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 1073741824 Sep 30 19:55:55 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e088418c-7145-49a1-86cf-b71c67844e7f tempest-ProjectReaderTests-576119329 None] Create snapshot completed successfully Sep 30 19:55:56 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 1073741824" returned: 0 in 0.489s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:56 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 Sep 30 19:55:56 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:56 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968" returned: 0 in 0.270s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.099s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-932872598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abd7eaa-6f78-4217-85f3-8c90c99b89af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:52Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Creating volume 6abd7eaa-6f78-4217-85f3-8c90c99b89af {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:56 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:56 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af 1073741824 Sep 30 19:55:56 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6850a379-628e-4697-9d71-aa1ce863cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6bcdde-9e78-42bf-bace-feac6df3f968', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3f5126-0262-4f48-9856-471a513b1e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:56 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 (3f6bcdde-9e78-42bf-bace-feac6df3f968): created successfully Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3f5126-0262-4f48-9856-471a513b1e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:56 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (c98550fe-4b94-4f39-a19c-b126c50713bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e87c3620-9d5e-43bc-896a-24dd1e9eea70 tempest-CreateVolumesFromSnapshotTest-439052887 None] Created volume successfully. Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-4bd0f290-dbfa-46de-bc3d-eca35e6bc451-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Lock "cinder-4bd0f290-dbfa-46de-bc3d-eca35e6bc451-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-18d5ac30-4eb2-4434-a68c-96a28a60c43c" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-18d5ac30-4eb2-4434-a68c-96a28a60c43c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-4bd0f290-dbfa-46de-bc3d-eca35e6bc451" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-4bd0f290-dbfa-46de-bc3d-eca35e6bc451" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Deleting offline snapshot 4bd0f290-dbfa-46de-bc3d-eca35e6bc451 of volume 18d5ac30-4eb2-4434-a68c-96a28a60c43c {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] snapshot_file for this snap is: volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72b8575-5811-40fd-9747-43680e6c3924]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:57 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af 1073741824" returned: 0 in 0.596s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:57 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 Sep 30 19:55:57 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:57 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af Sep 30 19:55:57 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:57 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451" returned: 0 in 0.468s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:55:57 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af" returned: 0 in 0.304s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.445s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143843786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa14c0d-3696-4637-8e4a-d7bbf5b4b773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf903c0ba4d94623b28e4ae21fd267a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:55:53Z,use_quota=True,user_id='3af155ef6d784a7788ae4b3448d7f7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Creating volume ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:55:57 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f73973-48b7-4dc2-a370-79988ab84058]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:57 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 1073741824 Sep 30 19:55:57 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa02a18a-c15c-4f03-ad77-cd3db286b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713adac0-fafd-4e0d-b83c-e0373ad7f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af (6abd7eaa-6f78-4217-85f3-8c90c99b89af): created successfully Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713adac0-fafd-4e0d-b83c-e0373ad7f41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (f327ffe2-433c-4573-affb-052f2e06b14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6ad061cb-98a9-45d4-9f2d-5c451542a01d tempest-CreateVolumesFromSnapshotTest-439052887 None] Created volume successfully. Sep 30 19:55:57 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c Sep 30 19:55:57 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:58 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c" returned: 0 in 0.443s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:58 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 1073741824" returned: 0 in 0.495s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:58 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 Sep 30 19:55:58 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:58 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 Sep 30 19:55:58 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:58 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773" returned: 0 in 0.315s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.299s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Creating offline snapshot 20436c1b-1183-4559-a7b4-331e3ac53a7a of volume 6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf46e66-0bb5-435b-bcea-e58d479eb593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:58 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63a886e-2e65-430a-b7f9-c3ea598f6898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451" returned: 0 in 0.436s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb16fb0-6b39-4727-abc4-0606544d827a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:58 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451 Sep 30 19:55:58 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:58 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Volume volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 (ffa14c0d-3696-4637-8e4a-d7bbf5b4b773): created successfully Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63a886e-2e65-430a-b7f9-c3ea598f6898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Flow 'volume_create_manager' (2d484e74-670f-4590-8249-ffe09b7d9552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:55:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-dbfb95a4-b870-452d-9122-ff81f01e5453 tempest-CreateVolumesFromSnapshotTest-439052887 None] Created volume successfully. Sep 30 19:55:58 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 Sep 30 19:55:58 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:58 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c.4bd0f290-dbfa-46de-bc3d-eca35e6bc451" returned: 0 in 0.309s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-4bd0f290-dbfa-46de-bc3d-eca35e6bc451" released by "_delete_snapshot" :: held 1.821s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-18d5ac30-4eb2-4434-a68c-96a28a60c43c" released by "delete_snapshot" :: held 1.865s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Created reservations ['de4743f0-10d7-46b8-b172-91efcacf669e', '362ca30e-f673-4669-87f4-687365d2061a', '81f5eaaf-7427-40f1-9123-cb2bfbcfb269', 'e47b9268-8a0e-445a-97bc-0eb4f7a41df7'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:55:59 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30" returned: 0 in 0.417s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:59 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a 1G Sep 30 19:55:59 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:59 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Delete snapshot completed successfully. Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ce2ab5ba-23d5-4e61-9cc4-95a8514f4b4d tempest-ProjectReaderTests-576119329 None] Lock "cinder-4bd0f290-dbfa-46de-bc3d-eca35e6bc451-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-18d5ac30-4eb2-4434-a68c-96a28a60c43c-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Lock "cinder-18d5ac30-4eb2-4434-a68c-96a28a60c43c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-18d5ac30-4eb2-4434-a68c-96a28a60c43c" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-18d5ac30-4eb2-4434-a68c-96a28a60c43c" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d52daf4-0c78-4b0e-a56f-13c2f2975d9f]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:59 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c Sep 30 19:55:59 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:59 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a 1G" returned: 0 in 0.542s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:59 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a Sep 30 19:55:59 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-quobyte-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[134dedc4-db4f-437d-ba8e-1f5bc7d9f537]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:59 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c" returned: 0 in 0.522s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:55:59 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 Sep 30 19:55:59 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:59 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c Sep 30 19:55:59 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:55:59 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a" returned: 0 in 0.415s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:55:59 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a is being set with open permissions: ugo+rw Sep 30 19:55:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:00 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a Sep 30 19:56:00 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:00 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-18d5ac30-4eb2-4434-a68c-96a28a60c43c" returned: 0 in 0.334s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:00 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773" returned: 0 in 0.479s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-18d5ac30-4eb2-4434-a68c-96a28a60c43c" released by "delete_volume" :: held 0.957s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:00 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a" returned: 0 in 0.314s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:00 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773 Sep 30 19:56:00 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:00 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.info Sep 30 19:56:00 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Created reservations ['a2dc4746-3f59-4ed8-9f3f-6ccdc03b33e5', '3dc8b97b-4d84-4001-af7d-4447d81e12c0', '85e0fc7d-ce66-4d83-aaf9-cbe30a3cac39', 'aca0cb48-20dc-457c-a005-f5ef098fbdba'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:00 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:00 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:00 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773" returned: 0 in 0.323s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773" released by "delete_volume" :: held 0.868s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:00 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.info" returned: 0 in 0.343s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:00 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.info is being set with open permissions: ugo+rw Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Created reservations ['3382a1c8-2b31-45a2-ad95-5dab01328bc7', '00b4876f-bef9-4616-869b-a91190884d2e', '7c852a70-fdcb-4fa3-b8c3-82a2e243bf13', 'c4c2efd2-8530-44a1-ba79-a9653ddf943d'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:00 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.info Sep 30 19:56:00 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:00 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.335s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Deleted volume successfully. Sep 30 19:56:00 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:00 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5dee5f78-11e7-46b9-9b77-9b107af29bb1 tempest-ProjectReaderTests-576119329 None] Lock "cinder-18d5ac30-4eb2-4434-a68c-96a28a60c43c-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:01 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.info" returned: 0 in 0.318s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:01 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-db62e7ff-3009-4347-8e3e-9ab13edbf9ec tempest-VolumeDependencyTests-1330950564 None] Create snapshot completed successfully Sep 30 19:56:01 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.317s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:01 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:01 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Deleted volume successfully. Sep 30 19:56:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0bae3ff6-9418-42b3-aecf-2759820bdf7d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-ffa14c0d-3696-4637-8e4a-d7bbf5b4b773-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-6abd7eaa-6f78-4217-85f3-8c90c99b89af-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-6abd7eaa-6f78-4217-85f3-8c90c99b89af-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-quobyte-6abd7eaa-6f78-4217-85f3-8c90c99b89af" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (50b2b760-8a2a-43fb-8e97-ba7117563a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a85754-8367-4328-b84b-38bc3b2f3fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-6abd7eaa-6f78-4217-85f3-8c90c99b89af" acquired by "delete_volume" :: waited 0.065s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a85754-8367-4328-b84b-38bc3b2f3fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913851837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2252a34-f76d-4379-8b77-b03fecd511c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:02Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bf7ea5-2c16-4c8b-a7d4-db955e1a5ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bf7ea5-2c16-4c8b-a7d4-db955e1a5ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba48cacd-741f-4548-8dce-8963fe90e828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba48cacd-741f-4548-8dce-8963fe90e828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2252a34-f76d-4379-8b77-b03fecd511c4', 'volume_name': 'volume-b2252a34-f76d-4379-8b77-b03fecd511c4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f2b0ab-3ed8-4ec2-9fc7-97421fae83fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f2b0ab-3ed8-4ec2-9fc7-97421fae83fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32734741-4cdd-4978-af61-185cec0f584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Volume b2252a34-f76d-4379-8b77-b03fecd511c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2252a34-f76d-4379-8b77-b03fecd511c4', 'volume_size': 1} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1913851837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2252a34-f76d-4379-8b77-b03fecd511c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:02Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Creating volume b2252a34-f76d-4379-8b77-b03fecd511c4 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:02 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0176aa1f-f7b0-4329-9774-261f3b11dfd5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:02 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 1073741824 Sep 30 19:56:02 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Flow 'volume_create_manager' (d505fae6-fbd6-462b-ace3-3d93719c596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0568cb37-1680-4c7a-a038-c91dd93100a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0568cb37-1680-4c7a-a038-c91dd93100a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1102694340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ae915d-5fdc-4daa-9010-9b8af8fae3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7477db253495407e922b92000f912782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20436c1b-1183-4559-a7b4-331e3ac53a7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:02Z,use_quota=True,user_id='28ec68d56d9f4234919e9fe72664a5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42abbb89-aa16-4c2a-85d2-f6fa62c60c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42abbb89-aa16-4c2a-85d2-f6fa62c60c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:02 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf59cc68-9bb4-41a9-bcdd-3010876b2804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf59cc68-9bb4-41a9-bcdd-3010876b2804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66ae915d-5fdc-4daa-9010-9b8af8fae3d6', 'volume_name': 'volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6', 'volume_size': 1, 'snapshot_id': '20436c1b-1183-4559-a7b4-331e3ac53a7a'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec89a70-50a4-4afd-9052-f18cca7e0bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec89a70-50a4-4afd-9052-f18cca7e0bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097655f7-31a9-4260-ab57-2c0b7a5205d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:02 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Volume 66ae915d-5fdc-4daa-9010-9b8af8fae3d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6', 'volume_size': 1, 'snapshot_id': '20436c1b-1183-4559-a7b4-331e3ac53a7a'} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:02 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af" returned: 0 in 0.466s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:02 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af Sep 30 19:56:02 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:02 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 1073741824" returned: 0 in 0.536s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:02 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 Sep 30 19:56:02 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:03 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6abd7eaa-6f78-4217-85f3-8c90c99b89af" returned: 0 in 0.348s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-6abd7eaa-6f78-4217-85f3-8c90c99b89af" released by "delete_volume" :: held 0.932s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:03 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4" returned: 0 in 0.298s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.695s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "cinder-quobyte-20436c1b-1183-4559-a7b4-331e3ac53a7a-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" by "_create_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32734741-4cdd-4978-af61-185cec0f584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2252a34-f76d-4379-8b77-b03fecd511c4', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bf38a0-4b06-4ef3-8d57-018b0523513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-20436c1b-1183-4559-a7b4-331e3ac53a7a-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Creating volume 66ae915d-5fdc-4daa-9010-9b8af8fae3d6 from snapshot 20436c1b-1183-4559-a7b4-331e3ac53a7a {{(pid=87426) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "cinder-quobyte-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:03 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Volume volume-b2252a34-f76d-4379-8b77-b03fecd511c4 (b2252a34-f76d-4379-8b77-b03fecd511c4): created successfully Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bf38a0-4b06-4ef3-8d57-018b0523513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (50b2b760-8a2a-43fb-8e97-ba7117563a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] snapshot: 20436c1b-1183-4559-a7b4-331e3ac53a7a, volume: 66ae915d-5fdc-4daa-9010-9b8af8fae3d6, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Created reservations ['a51a9b51-c1de-4e14-9f18-c5b1cdfa33f3', 'd0e6a3c0-0ea0-4249-b0fc-771d06256617', '33b5196e-6a49-4423-9d16-67cf9096868e', '467931af-7ee4-4814-9a23-67997628ac07'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3dbf79e0-bc6f-49ce-a19f-3d72a551c8bf tempest-ProjectReaderTests-576119329 None] Created volume successfully. Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[df90e1fd-9fc2-467d-8565-40fae6ab72c5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:03 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:03 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:03 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a Sep 30 19:56:03 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:03 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.276s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Deleted volume successfully. Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d02a61fd-3489-47d8-851c-044e70643f5f tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-6abd7eaa-6f78-4217-85f3-8c90c99b89af-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:03 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a" returned: 0 in 0.426s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e7efa11-0da9-4040-bb7b-7728916f6d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f633179-0b33-41f5-ac23-7778277d9b9d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:03 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 Sep 30 19:56:03 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:04 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30" returned: 0 in 0.403s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:04 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 Sep 30 19:56:04 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-3f6bcdde-9e78-42bf-bace-feac6df3f968-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-3f6bcdde-9e78-42bf-bace-feac6df3f968-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-quobyte-3f6bcdde-9e78-42bf-bace-feac6df3f968" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-3f6bcdde-9e78-42bf-bace-feac6df3f968" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[503c4e73-7115-4196-a553-e4b5fa80c135]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:04 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 Sep 30 19:56:04 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:05 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968" returned: 0 in 0.551s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:05 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968 Sep 30 19:56:05 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:05 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-3f6bcdde-9e78-42bf-bace-feac6df3f968" returned: 0 in 0.541s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-3f6bcdde-9e78-42bf-bace-feac6df3f968" released by "delete_volume" :: held 1.166s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Created reservations ['abae3ff1-ea3c-4643-86f0-295cc85d91fa', '091d17b3-27a5-416b-97d7-947f6689f05f', 'a39731e1-4260-446d-b8dd-cfcd17c32b01', '416c9c5f-641b-40f9-a43a-9f480cf051c1'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:05 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:05 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:06 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.498s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:06 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:06 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Deleted volume successfully. Sep 30 19:56:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-40ea72ce-11db-4ca4-9200-71f814e6406d tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-3f6bcdde-9e78-42bf-bace-feac6df3f968-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-64186782-6b84-4238-aafa-af3984156f69-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-64186782-6b84-4238-aafa-af3984156f69-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-quobyte-64186782-6b84-4238-aafa-af3984156f69" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:06 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-64186782-6b84-4238-aafa-af3984156f69" acquired by "delete_volume" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:06 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cea13f9-9886-46e0-8176-b967d5629b75]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:07 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69 Sep 30 19:56:07 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:07 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69" returned: 0 in 0.780s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:07 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69 Sep 30 19:56:07 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:07 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-64186782-6b84-4238-aafa-af3984156f69" returned: 0 in 0.332s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-64186782-6b84-4238-aafa-af3984156f69" released by "delete_volume" :: held 1.195s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Created reservations ['29069678-c695-4ea7-b52e-bf85bed46539', '4d24d157-b26e-4bbc-b455-b69f0e6cf438', '23114625-25da-42fe-9f65-1a356f5a80d3', '1926ddeb-dd11-445a-913f-6a8278b7ed9e'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:08 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:08 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:08 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.331s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:08 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Deleted volume successfully. Sep 30 19:56:08 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e13e69b8-ccdf-4918-afe4-4df965332742 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-64186782-6b84-4238-aafa-af3984156f69-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-416d18f0-03f3-476f-b530-0734ec0bfb69-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-416d18f0-03f3-476f-b530-0734ec0bfb69-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-quobyte-416d18f0-03f3-476f-b530-0734ec0bfb69" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-416d18f0-03f3-476f-b530-0734ec0bfb69" acquired by "delete_volume" :: waited 0.039s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:09 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efdbe97-ec35-49b6-8a0e-657ac755bac6]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:09 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69 Sep 30 19:56:09 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:10 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69" returned: 0 in 1.034s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:10 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69 Sep 30 19:56:10 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:10 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-416d18f0-03f3-476f-b530-0734ec0bfb69" returned: 0 in 0.401s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:10 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-416d18f0-03f3-476f-b530-0734ec0bfb69" released by "delete_volume" :: held 1.536s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:10 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Created reservations ['b6b1d121-ec53-4f60-a7cd-8bc96c6b81fa', 'f64a932d-146d-44e0-be46-6aeac88bb77c', '47f5b140-7c2a-4946-8051-9c8136acda0c', '31a76672-b56b-4463-880f-3075f1e51eca'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:11 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:11 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:11 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.479s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:11 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Deleted volume successfully. Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-61fd0cc9-22c4-464a-8ad8-924aa5e8c18a-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9ac3afdb-50db-4dc7-8869-ed348fc5c042 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-416d18f0-03f3-476f-b530-0734ec0bfb69-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-61fd0cc9-22c4-464a-8ad8-924aa5e8c18a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-quobyte-89721376-0ac9-4d25-a203-1c5d9cfef823" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-89721376-0ac9-4d25-a203-1c5d9cfef823" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-quobyte-61fd0cc9-22c4-464a-8ad8-924aa5e8c18a" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-61fd0cc9-22c4-464a-8ad8-924aa5e8c18a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Deleting offline snapshot 61fd0cc9-22c4-464a-8ad8-924aa5e8c18a of volume 89721376-0ac9-4d25-a203-1c5d9cfef823 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] snapshot_file for this snap is: volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[24863563-d669-4231-925d-315958b4a2aa]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:12 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a Sep 30 19:56:12 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:12 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a" returned: 0 in 0.670s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89721376-0ac9-4d25-a203-1c5d9cfef823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:56:12 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[649b3340-3b40-4854-801a-2cec51c2cf65]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:12 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" returned: 0 in 8.558s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:12 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30, size 1024.00 MB, duration 8.56 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:56:12 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Converted 1024.00 MB image at 119.61 MB/s Sep 30 19:56:12 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 is being set with open permissions: ugo+rw Sep 30 19:56:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:12 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 Sep 30 19:56:12 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:12 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 Sep 30 19:56:12 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:13 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" returned: 0 in 0.278s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:13 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" released by "_copy_volume_from_snapshot" :: held 9.777s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823" returned: 0 in 0.453s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:13 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a Sep 30 19:56:13 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-20436c1b-1183-4559-a7b4-331e3ac53a7a-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" released by "_create_volume_from_snapshot" :: held 9.893s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.943s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.762s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Creating offline snapshot 8ef7d075-c039-495f-8bff-271f20aa9569 of volume b2252a34-f76d-4379-8b77-b03fecd511c4 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097655f7-31a9-4260-ab57-2c0b7a5205d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6', 'volume_size': 1, 'snapshot_id': '20436c1b-1183-4559-a7b4-331e3ac53a7a'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0acc46c-c489-46e9-84ed-0b2a9b21d7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91204e7-0714-4fe9-8b0e-ba9f9f6a944b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:13 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Volume volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 (66ae915d-5fdc-4daa-9010-9b8af8fae3d6): created successfully Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0acc46c-c489-46e9-84ed-0b2a9b21d7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Flow 'volume_create_manager' (d505fae6-fbd6-462b-ace3-3d93719c596a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:13 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-dcbfc5d9-78ae-4fe7-b817-35fcc0c1b45c tempest-VolumeDependencyTests-1330950564 None] Created volume successfully. Sep 30 19:56:13 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 Sep 30 19:56:13 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:13 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a" returned: 0 in 0.390s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:13 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a Sep 30 19:56:13 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:13 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4" returned: 0 in 0.426s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:13 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 1G Sep 30 19:56:13 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:13 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823.61fd0cc9-22c4-464a-8ad8-924aa5e8c18a" returned: 0 in 0.284s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-61fd0cc9-22c4-464a-8ad8-924aa5e8c18a" released by "_delete_snapshot" :: held 2.036s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-89721376-0ac9-4d25-a203-1c5d9cfef823" released by "delete_snapshot" :: held 2.082s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Created reservations ['a1255319-f453-45c4-8ba1-38ace779cf13', '57676d7c-16af-475a-81cf-6899bbd28f7f', '54491891-2b67-4059-83c8-e0c22a2729b3', '7bdde856-25d7-4c0d-ba5e-71453ce6a23d'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:13 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Delete snapshot completed successfully. Sep 30 19:56:13 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-7850c3cd-91c9-4aa6-bacf-fbd2525eadfc tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-61fd0cc9-22c4-464a-8ad8-924aa5e8c18a-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:14 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 1G" returned: 0 in 0.494s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2252a34-f76d-4379-8b77-b03fecd511c4 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:14 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2252a34-f76d-4379-8b77-b03fecd511c4 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 Sep 30 19:56:14 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "cinder-20436c1b-1183-4559-a7b4-331e3ac53a7a-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-20436c1b-1183-4559-a7b4-331e3ac53a7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "cinder-quobyte-6e7efa11-0da9-4040-bb7b-7728916f6d30" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-6e7efa11-0da9-4040-bb7b-7728916f6d30" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "cinder-quobyte-20436c1b-1183-4559-a7b4-331e3ac53a7a" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-20436c1b-1183-4559-a7b4-331e3ac53a7a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Deleting offline snapshot 20436c1b-1183-4559-a7b4-331e3ac53a7a of volume 6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] snapshot_file for this snap is: volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6883e901-c385-4115-b371-1b7466df1262]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:14 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2252a34-f76d-4379-8b77-b03fecd511c4 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569" returned: 0 in 0.336s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:14 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 is being set with open permissions: ugo+rw Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:14 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 Sep 30 19:56:14 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Flow 'volume_create_manager' (27edc1cf-df3c-40d5-ac41-9bc2201e5b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dd4406-bbad-4574-88f4-7d29f688a0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dd4406-bbad-4574-88f4-7d29f688a0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169358582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c4683a-b2df-4250-a5b0-37a6c52cec9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec99eee1fbb42ae9b2533ae3af65021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:14Z,use_quota=True,user_id='4ad3905701e44c30aa452f0f8b3ffeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760dda56-65e5-4102-9efb-3408d9c64fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760dda56-65e5-4102-9efb-3408d9c64fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:14 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e5bc24-6e12-4eeb-ad6e-aaf6e655f067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:14 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e5bc24-6e12-4eeb-ad6e-aaf6e655f067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c4683a-b2df-4250-a5b0-37a6c52cec9d', 'volume_name': 'volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c06f55-6eb5-4fe7-bd24-3364a7d5a6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c06f55-6eb5-4fe7-bd24-3364a7d5a6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f66bbe9-a86c-44f7-b85a-9837b2517bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:14 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Volume e4c4683a-b2df-4250-a5b0-37a6c52cec9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d', 'volume_size': 1} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:14 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569" returned: 0 in 0.259s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:14 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.info Sep 30 19:56:14 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:14 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a" returned: 0 in 0.392s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e7efa11-0da9-4040-bb7b-7728916f6d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d9b821-bf9e-4b28-ae5b-28f6e553ffbb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-89721376-0ac9-4d25-a203-1c5d9cfef823-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:14 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-89721376-0ac9-4d25-a203-1c5d9cfef823-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:14 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 Sep 30 19:56:14 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "cinder-quobyte-89721376-0ac9-4d25-a203-1c5d9cfef823" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:15 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.info" returned: 0 in 0.309s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:15 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.info is being set with open permissions: ugo+rw Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-89721376-0ac9-4d25-a203-1c5d9cfef823" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:15 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.info Sep 30 19:56:15 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaa28ee-49a7-4fd0-9a24-c145cabf04d4]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:15 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 Sep 30 19:56:15 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:15 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.info" returned: 0 in 0.310s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169358582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c4683a-b2df-4250-a5b0-37a6c52cec9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec99eee1fbb42ae9b2533ae3af65021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:14Z,use_quota=True,user_id='4ad3905701e44c30aa452f0f8b3ffeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Creating volume e4c4683a-b2df-4250-a5b0-37a6c52cec9d {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:15 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:15 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d 1073741824 Sep 30 19:56:15 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:15 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d16a8576-6968-45e3-ab45-7a51944c19d8 tempest-ProjectReaderTests-576119329 None] Create snapshot completed successfully Sep 30 19:56:15 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30" returned: 0 in 0.622s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:15 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a Sep 30 19:56:15 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:15 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823" returned: 0 in 0.392s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:15 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823 Sep 30 19:56:15 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:15 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-89721376-0ac9-4d25-a203-1c5d9cfef823" returned: 0 in 0.270s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-quobyte-89721376-0ac9-4d25-a203-1c5d9cfef823" released by "delete_volume" :: held 0.745s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:15 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a" returned: 0 in 0.375s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Created reservations ['1be4080d-5330-40f1-a7c7-6187617c412a', 'a30bc97a-9941-4a10-bba3-c736bc00f62e', '5b16013f-93f1-4872-b797-9c5526885d34', 'feb7288d-aa4d-42ac-a71e-e0e72474ae66'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:15 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d 1073741824" returned: 0 in 0.479s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:15 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a Sep 30 19:56:15 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:15 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d Sep 30 19:56:15 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:15 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:16 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:16 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-8ef7d075-c039-495f-8bff-271f20aa9569-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Lock "cinder-8ef7d075-c039-495f-8bff-271f20aa9569-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-b2252a34-f76d-4379-8b77-b03fecd511c4" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-b2252a34-f76d-4379-8b77-b03fecd511c4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-8ef7d075-c039-495f-8bff-271f20aa9569" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-8ef7d075-c039-495f-8bff-271f20aa9569" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Deleting offline snapshot 8ef7d075-c039-495f-8bff-271f20aa9569 of volume b2252a34-f76d-4379-8b77-b03fecd511c4 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:56:16 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:16 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] snapshot_file for this snap is: volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30.20436c1b-1183-4559-a7b4-331e3ac53a7a" returned: 0 in 0.370s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d" returned: 0 in 0.296s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cb4d69-b532-4318-bdfd-5ec8c14664ed]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f66bbe9-a86c-44f7-b85a-9837b2517bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960941da-0bed-4adb-9629-3e2c333f3470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:16 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.317s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-20436c1b-1183-4559-a7b4-331e3ac53a7a" released by "_delete_snapshot" :: held 1.943s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:16 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Volume volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d (e4c4683a-b2df-4250-a5b0-37a6c52cec9d): created successfully Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960941da-0bed-4adb-9629-3e2c333f3470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Flow 'volume_create_manager' (27edc1cf-df3c-40d5-ac41-9bc2201e5b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Deleted volume successfully. Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-6e7efa11-0da9-4040-bb7b-7728916f6d30" released by "delete_snapshot" :: held 1.991s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f3b94b62-546b-497f-8e4e-909730014cd1 tempest-ProjectReaderTests-557976045 None] Created volume successfully. Sep 30 19:56:16 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 Sep 30 19:56:16 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a0d289aa-5216-42f1-acd1-9e950ebf3c06 tempest-CreateVolumesFromSnapshotTest-439052887 None] Lock "cinder-89721376-0ac9-4d25-a203-1c5d9cfef823-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Created reservations ['bb7e3b9a-b493-4036-942a-a0d737abc4a8', '4dc57636-6d97-47ce-a1fa-7c7cea9f2140', '6082bd6d-54fb-4267-832c-9677d2187672', '8b3c8b1c-d3e3-49a8-80d9-39a945412a76'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:16 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Delete snapshot completed successfully. Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-028046b8-7869-4e35-8daa-00c6bd6a386c tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-20436c1b-1183-4559-a7b4-331e3ac53a7a-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Acquiring lock "cinder-e4c4683a-b2df-4250-a5b0-37a6c52cec9d-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Lock "cinder-e4c4683a-b2df-4250-a5b0-37a6c52cec9d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:16 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569" returned: 0 in 0.495s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2252a34-f76d-4379-8b77-b03fecd511c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e2b1f8-8b72-4cff-89db-bbe17570f3ee]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Acquiring lock "cinder-quobyte-e4c4683a-b2df-4250-a5b0-37a6c52cec9d" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Lock "cinder-quobyte-e4c4683a-b2df-4250-a5b0-37a6c52cec9d" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c244559-c0b1-496d-b70e-d2baaa0c4596]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:16 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:16 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 Sep 30 19:56:16 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:16 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d Sep 30 19:56:16 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:17 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4" returned: 0 in 0.457s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:17 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 Sep 30 19:56:17 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:17 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d" returned: 0 in 0.441s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:17 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d Sep 30 19:56:17 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "cinder-6e7efa11-0da9-4040-bb7b-7728916f6d30-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-6e7efa11-0da9-4040-bb7b-7728916f6d30-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "cinder-quobyte-6e7efa11-0da9-4040-bb7b-7728916f6d30" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:17 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-e4c4683a-b2df-4250-a5b0-37a6c52cec9d" returned: 0 in 0.338s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-6e7efa11-0da9-4040-bb7b-7728916f6d30" acquired by "delete_volume" :: waited 0.036s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:17 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569" returned: 0 in 0.452s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Lock "cinder-quobyte-e4c4683a-b2df-4250-a5b0-37a6c52cec9d" released by "delete_volume" :: held 0.873s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29feb27-daaa-47e4-9d2d-dafbfccc28f8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:17 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569 Sep 30 19:56:17 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Created reservations ['13fc4ebf-a9dc-4aaf-924b-9a4a7d5b5d07', 'e207c497-8cc3-463d-84da-9c7a813ef7c2', '74cbf867-d7ae-43ef-9292-4b3c66af0624', 'ff9f87d0-a181-405a-9ded-e65be9e8cdae'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:17 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 Sep 30 19:56:17 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:17 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:17 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:17 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:17 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4.8ef7d075-c039-495f-8bff-271f20aa9569" returned: 0 in 0.299s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-8ef7d075-c039-495f-8bff-271f20aa9569" released by "_delete_snapshot" :: held 1.852s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-b2252a34-f76d-4379-8b77-b03fecd511c4" released by "delete_snapshot" :: held 1.891s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Created reservations ['82416c45-aea0-44a6-8f60-8f64639ef450', '59ed8549-dc79-4700-8b84-d5c07f7e1462', 'ed82111b-7f4d-40d7-9c7e-f6352340350e', 'db4f9e6d-3e81-4a9f-985a-48600c5f3090'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:18 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.310s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:18 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30" returned: 0 in 0.488s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Deleted volume successfully. Sep 30 19:56:18 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Delete snapshot completed successfully. Sep 30 19:56:18 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30 Sep 30 19:56:18 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-0fb9d63c-db65-4461-8b63-6df522805a74 tempest-ProjectReaderTests-576119329 None] Lock "cinder-8ef7d075-c039-495f-8bff-271f20aa9569-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-94bcee6b-c5ef-4520-95fb-7b5a692fdd4e tempest-ProjectReaderTests-557976045 None] Lock "cinder-e4c4683a-b2df-4250-a5b0-37a6c52cec9d-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-b2252a34-f76d-4379-8b77-b03fecd511c4-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Lock "cinder-b2252a34-f76d-4379-8b77-b03fecd511c4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-b2252a34-f76d-4379-8b77-b03fecd511c4" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-b2252a34-f76d-4379-8b77-b03fecd511c4" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed80931-b6d6-4b99-ad68-0941d4a5b477]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:18 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6e7efa11-0da9-4040-bb7b-7728916f6d30" returned: 0 in 0.294s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-6e7efa11-0da9-4040-bb7b-7728916f6d30" released by "delete_volume" :: held 0.870s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=283,cinder:SELECT=206,cinder:DELETE=21,cinder:INSERT=75 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Created reservations ['9d3c2dd0-678a-4a51-a85b-86028a7fa117', '7f0a21bc-034c-4991-9bd6-274abb0e9a92', '274e273b-1c7f-4a3d-933f-3f5ffff7beac', '1047265f-dfbb-4939-a20d-81a5e19fc071'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:18 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 Sep 30 19:56:18 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:18 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:18 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "cinder-66ae915d-5fdc-4daa-9010-9b8af8fae3d6-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-66ae915d-5fdc-4daa-9010-9b8af8fae3d6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=228,cinder:UPDATE=306,cinder:INSERT=72,cinder:DELETE=29 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "cinder-quobyte-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f4bf9e-6e34-4f41-89fa-cb27d1b1c736]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:18 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4" returned: 0 in 0.497s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:18 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:19 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4 Sep 30 19:56:19 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:19 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 Sep 30 19:56:19 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:19 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.482s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:19 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Deleted volume successfully. Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5fc65028-4a3c-4463-8b7a-bf6937a7ca98 tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-6e7efa11-0da9-4040-bb7b-7728916f6d30-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:19 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-b2252a34-f76d-4379-8b77-b03fecd511c4" returned: 0 in 0.456s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-b2252a34-f76d-4379-8b77-b03fecd511c4" released by "delete_volume" :: held 1.046s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Created reservations ['1b1b3a42-3b4a-4b28-9354-73156a091611', '2d291010-26bf-45d2-9f6f-afc9053db4d0', 'd7d419d3-d7c8-4cfc-971e-50086decafb2', 'a555b9b3-f9db-4349-b525-76b230fb1b2a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:19 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" returned: 0 in 0.660s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:19 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6 Sep 30 19:56:19 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:19 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:19 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Flow 'volume_create_manager' (e9010207-170d-40f8-8a8e-57b28a4ea312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b5e241-61a5-4609-ab11-c346beda1bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b5e241-61a5-4609-ab11-c346beda1bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366596359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272e1768-cbc2-41d0-b8f5-00d10578e567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec99eee1fbb42ae9b2533ae3af65021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:20Z,use_quota=True,user_id='4ad3905701e44c30aa452f0f8b3ffeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e669701-4149-4709-baa5-25b99b297233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e669701-4149-4709-baa5-25b99b297233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4268c0b-12ad-496c-82b4-1553e8aa8339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4268c0b-12ad-496c-82b4-1553e8aa8339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272e1768-cbc2-41d0-b8f5-00d10578e567', 'volume_name': 'volume-272e1768-cbc2-41d0-b8f5-00d10578e567', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5100bc-9a56-4835-b1dc-7ea99a9b293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5100bc-9a56-4835-b1dc-7ea99a9b293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ebb405-336f-4c96-8d30-b3c35e606255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:19 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Volume 272e1768-cbc2-41d0-b8f5-00d10578e567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272e1768-cbc2-41d0-b8f5-00d10578e567', 'volume_size': 1} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366596359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272e1768-cbc2-41d0-b8f5-00d10578e567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec99eee1fbb42ae9b2533ae3af65021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:20Z,use_quota=True,user_id='4ad3905701e44c30aa452f0f8b3ffeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Creating volume 272e1768-cbc2-41d0-b8f5-00d10578e567 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:19 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:19 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567 1073741824 Sep 30 19:56:19 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:19 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" returned: 0 in 0.339s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-quobyte-66ae915d-5fdc-4daa-9010-9b8af8fae3d6" released by "delete_volume" :: held 1.060s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:19 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.335s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:19 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:19 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Deleted volume successfully. Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-c6776c72-6c1b-45f6-ab4e-65b45609d424 tempest-ProjectReaderTests-576119329 None] Lock "cinder-b2252a34-f76d-4379-8b77-b03fecd511c4-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Created reservations ['7d6172dd-3c96-4d6d-8308-5717ace22b36', '2c017c10-9374-4b7d-b63d-a5480421a8ad', 'fb218f1b-9c94-4162-9290-eec33066ce4b', '1f34d062-46e3-4eaa-89df-e6a9b89eb6cf'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:20 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:20 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:20 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567 1073741824" returned: 0 in 0.568s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:20 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567 Sep 30 19:56:20 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:20 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.282s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Deleted volume successfully. Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-78db5eb1-73ac-49f2-8310-51b93407f820 tempest-VolumeDependencyTests-1330950564 None] Lock "cinder-66ae915d-5fdc-4daa-9010-9b8af8fae3d6-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:20 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567" returned: 0 in 0.290s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ebb405-336f-4c96-8d30-b3c35e606255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272e1768-cbc2-41d0-b8f5-00d10578e567', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1add45-7c1b-4189-8077-36f8733baf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:20 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Volume volume-272e1768-cbc2-41d0-b8f5-00d10578e567 (272e1768-cbc2-41d0-b8f5-00d10578e567): created successfully Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1add45-7c1b-4189-8077-36f8733baf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Flow 'volume_create_manager' (e9010207-170d-40f8-8a8e-57b28a4ea312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fd7c4c8b-6868-4b01-8053-b202049ec365 tempest-ProjectReaderTests-557976045 None] Created volume successfully. Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (b6d83920-1e7e-497d-ba51-4f6b3184d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a9bbe7-7f11-4550-b3f7-9d2544dcde62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a9bbe7-7f11-4550-b3f7-9d2544dcde62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972926587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4aae52-0c05-4a2a-b1a9-2ba449381615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:21Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be5c522-54c4-4302-a391-2b8805641af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be5c522-54c4-4302-a391-2b8805641af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c03db01-c896-4064-a335-96b80a182cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c03db01-c896-4064-a335-96b80a182cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a4aae52-0c05-4a2a-b1a9-2ba449381615', 'volume_name': 'volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e641bbf2-2b9b-4cc4-9143-bee0aca2171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e641bbf2-2b9b-4cc4-9143-bee0aca2171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa04971-fa2e-4258-8901-e90bb47310d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:21 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Volume 2a4aae52-0c05-4a2a-b1a9-2ba449381615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615', 'volume_size': 1} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972926587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4aae52-0c05-4a2a-b1a9-2ba449381615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:21Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Creating volume 2a4aae52-0c05-4a2a-b1a9-2ba449381615 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:21 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:21 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 1073741824 Sep 30 19:56:21 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:21 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 1073741824" returned: 0 in 0.515s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:21 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 Sep 30 19:56:21 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Acquiring lock "cinder-272e1768-cbc2-41d0-b8f5-00d10578e567-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Lock "cinder-272e1768-cbc2-41d0-b8f5-00d10578e567-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Acquiring lock "cinder-quobyte-272e1768-cbc2-41d0-b8f5-00d10578e567" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Lock "cinder-quobyte-272e1768-cbc2-41d0-b8f5-00d10578e567" acquired by "delete_volume" :: waited 0.033s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df3c43a-1b15-4e75-956a-0aaac004ef62]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:22 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615" returned: 0 in 0.355s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa04971-fa2e-4258-8901-e90bb47310d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1319bae1-e64e-4b41-9177-b39b81c343ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:22 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Volume volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 (2a4aae52-0c05-4a2a-b1a9-2ba449381615): created successfully Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1319bae1-e64e-4b41-9177-b39b81c343ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (b6d83920-1e7e-497d-ba51-4f6b3184d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:22 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2cc0cbde-3a58-43e8-9e23-5da2259df30d tempest-ProjectReaderTests-576119329 None] Created volume successfully. Sep 30 19:56:22 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567 Sep 30 19:56:22 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:22 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567" returned: 0 in 0.422s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:22 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567 Sep 30 19:56:22 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:22 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-272e1768-cbc2-41d0-b8f5-00d10578e567" returned: 0 in 0.297s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Lock "cinder-quobyte-272e1768-cbc2-41d0-b8f5-00d10578e567" released by "delete_volume" :: held 0.800s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Created reservations ['89ad8e2d-15c8-450b-941c-23310863d0b8', '33b6fad9-7de9-412a-84c4-b14af1391c34', '5258e8c2-d9a3-4f28-a408-dee5dc1ec51c', '3dc0686d-b45b-4a68-a31e-253998275695'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:23 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:23 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Flow 'volume_create_manager' (5618a5d4-b08a-4f19-af1b-3a570aa6917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6459f7a0-d3a2-4aad-a5c4-a4b2be9f6d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6459f7a0-d3a2-4aad-a5c4-a4b2be9f6d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c8f375-59da-4fb6-b8a4-0adac54ef07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d986d8d22e344969abbe366a591cdf3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:23Z,use_quota=True,user_id='65d2140e35944d3c81566fa0a4a00ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1caf59-8086-419f-ae46-31d00c455faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1caf59-8086-419f-ae46-31d00c455faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b3e761-a873-445d-81ef-c12eb92f0ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.image.glance [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Creating Keystone auth plugin from conf {{(pid=87426) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 19:56:23 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.397s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:23 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Deleted volume successfully. Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2cc6ab89-7bbf-4d86-8041-eae13716e6ab tempest-ProjectReaderTests-557976045 None] Lock "cinder-272e1768-cbc2-41d0-b8f5-00d10578e567-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Creating offline snapshot 300e0474-0169-44ea-8f78-e8ef9e9201f3 of volume 2a4aae52-0c05-4a2a-b1a9-2ba449381615 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6763c041-956f-403c-b9c4-7b17a7fba1dd]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:23 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 Sep 30 19:56:23 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Flow 'volume_create_manager' (30195c88-d5f3-4d3e-bdcb-d0bc1afd9840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dc19ff-81bf-46a7-a0e3-7bf86260a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b3e761-a873-445d-81ef-c12eb92f0ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03c8f375-59da-4fb6-b8a4-0adac54ef07a', 'volume_name': 'volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a', 'volume_size': 1, 'image_id': '727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b165635b989aaa6852abe70312851e9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd986d8d22e344969abbe366a591cdf3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a61fe9692e687b9535971818f9b221e249698326602efdc3c2144257c1f157876ba1bc0141eecbf861df3b7c7c5d4c89071092c3f181ca4b48254613e1098b12', 'id': '727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'created_at': datetime.datetime(2026, 9, 30, 17, 56, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 56, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/727ee45e-7692-4586-b6f2-4331c7dbc3ee/file', 'properties': {}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03230b96-b7bd-4678-92e1-e2f658a58d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03230b96-b7bd-4678-92e1-e2f658a58d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0949c09f-943b-489e-be9c-f1df0a56c143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Volume 03c8f375-59da-4fb6-b8a4-0adac54ef07a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a', 'volume_size': 1, 'image_id': '727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b165635b989aaa6852abe70312851e9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd986d8d22e344969abbe366a591cdf3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a61fe9692e687b9535971818f9b221e249698326602efdc3c2144257c1f157876ba1bc0141eecbf861df3b7c7c5d4c89071092c3f181ca4b48254613e1098b12', 'id': '727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'created_at': datetime.datetime(2026, 9, 30, 17, 56, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 56, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/727ee45e-7692-4586-b6f2-4331c7dbc3ee/file', 'properties': {}}, 'image_service': } Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Trying to clone 03c8f375-59da-4fb6-b8a4-0adac54ef07a from image 727ee45e-7692-4586-b6f2-4331c7dbc3ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'metadata': {}}]). {{(pid=87426) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dc19ff-81bf-46a7-a0e3-7bf86260a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398551526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c167a0b-a1d4-4fe5-8fb6-0beeb457005e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec99eee1fbb42ae9b2533ae3af65021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:24Z,use_quota=True,user_id='4ad3905701e44c30aa452f0f8b3ffeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8950dbea-15aa-49b7-8940-2a15a9c2d92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8950dbea-15aa-49b7-8940-2a15a9c2d92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2a885d-6a22-43d1-a728-c48234d93395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2a885d-6a22-43d1-a728-c48234d93395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c167a0b-a1d4-4fe5-8fb6-0beeb457005e', 'volume_name': 'volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19b7d8b-8f2d-4772-9083-34f5a34770bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19b7d8b-8f2d-4772-9083-34f5a34770bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15aa9c37-a32c-4b05-99e0-618b9c223ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:23 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Volume 8c167a0b-a1d4-4fe5-8fb6-0beeb457005e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e', 'volume_size': 1} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:23 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 19:56:23 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Image download 0.00 MB at 0.00 MB/s Sep 30 19:56:23 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:23 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:24 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615" returned: 0 in 0.422s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:24 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 1G Sep 30 19:56:24 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[89815fc3-2e29-48c8-ab47-3cd999490e3a]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:24 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD Sep 30 19:56:24 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:24 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.316s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:56:24 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:24 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 1G" returned: 0 in 0.492s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:24 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD Sep 30 19:56:24 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:24 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 Sep 30 19:56:24 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:24 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Temporary image 727ee45e-7692-4586-b6f2-4331c7dbc3ee is fetched for user 65d2140e35944d3c81566fa0a4a00ccb. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Flow 'volume_create_manager' (c766cabe-7519-489c-ba21-2c324456a219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a0370c-9457-4614-baf2-3145e92214c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:24 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3" returned: 0 in 0.364s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:24 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 is being set with open permissions: ugo+rw Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a0370c-9457-4614-baf2-3145e92214c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4137c1ec4f82411b9396bdae04f74c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:25Z,use_quota=True,user_id='4b6b07ef25d44dd9b74e2408df1a58de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9ca63b-079e-491a-925e-504ed15c4021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:24 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 Sep 30 19:56:24 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9ca63b-079e-491a-925e-504ed15c4021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f1b6b1-7070-49fa-8cb8-cdc8fc0d0f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f1b6b1-7070-49fa-8cb8-cdc8fc0d0f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97', 'volume_name': 'volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e49fb44-139c-4b26-a403-0757ed0924c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e49fb44-139c-4b26-a403-0757ed0924c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4598fe-face-4ca4-b36f-49e00a8718bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:24 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Volume 7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97', 'volume_size': 1} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c80df0-8574-48d2-b7bb-32985e425dc9]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:25 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD Sep 30 19:56:25 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:25 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3" returned: 0 in 0.260s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:25 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.info Sep 30 19:56:25 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:25 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:25 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD Sep 30 19:56:25 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:25 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.info" returned: 0 in 0.261s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:25 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.info is being set with open permissions: ugo+rw Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:25 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.info Sep 30 19:56:25 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:25 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:25 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.info" returned: 0 in 0.249s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398551526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c167a0b-a1d4-4fe5-8fb6-0beeb457005e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec99eee1fbb42ae9b2533ae3af65021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:24Z,use_quota=True,user_id='4ad3905701e44c30aa452f0f8b3ffeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Creating volume 8c167a0b-a1d4-4fe5-8fb6-0beeb457005e {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:25 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:25 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e 1073741824 Sep 30 19:56:25 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:25 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-793e44f5-2074-4368-8351-5ae4ff332510 tempest-ProjectReaderTests-576119329 None] Create snapshot completed successfully Sep 30 19:56:26 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e 1073741824" returned: 0 in 0.450s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:26 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e Sep 30 19:56:26 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:26 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e" returned: 0 in 0.245s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4137c1ec4f82411b9396bdae04f74c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:25Z,use_quota=True,user_id='4b6b07ef25d44dd9b74e2408df1a58de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Creating volume 7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:26 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15aa9c37-a32c-4b05-99e0-618b9c223ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:26 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 1073741824 Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee905516-c6d5-4364-8f3e-37385e33b800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:26 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:26 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Volume volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e (8c167a0b-a1d4-4fe5-8fb6-0beeb457005e): created successfully Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee905516-c6d5-4364-8f3e-37385e33b800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Flow 'volume_create_manager' (30195c88-d5f3-4d3e-bdcb-d0bc1afd9840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:26 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-59a9be70-f814-40dc-a25d-36fb6dff7a5f tempest-ProjectReaderTests-557976045 None] Created volume successfully. Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-300e0474-0169-44ea-8f78-e8ef9e9201f3-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-300e0474-0169-44ea-8f78-e8ef9e9201f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-2a4aae52-0c05-4a2a-b1a9-2ba449381615" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-2a4aae52-0c05-4a2a-b1a9-2ba449381615" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-300e0474-0169-44ea-8f78-e8ef9e9201f3" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-300e0474-0169-44ea-8f78-e8ef9e9201f3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Deleting offline snapshot 300e0474-0169-44ea-8f78-e8ef9e9201f3 of volume 2a4aae52-0c05-4a2a-b1a9-2ba449381615 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] snapshot_file for this snap is: volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[21689cc8-a962-4f36-8ef9-29288224fac9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:26 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 Sep 30 19:56:26 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:26 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 1073741824" returned: 0 in 0.532s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Acquiring lock "cinder-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Lock "cinder-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Acquiring lock "cinder-quobyte-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:27 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 Sep 30 19:56:27 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Lock "cinder-quobyte-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5e4660-c90d-47b3-8544-a84dbe370350]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:27 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3" returned: 0 in 0.421s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b69887c-56a9-43e1-b9cf-ad44e1cfaeec]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:27 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e Sep 30 19:56:27 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:27 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97" returned: 0 in 0.290s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.744s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c8f375-59da-4fb6-b8a4-0adac54ef07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d986d8d22e344969abbe366a591cdf3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:23Z,use_quota=True,user_id='65d2140e35944d3c81566fa0a4a00ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Creating volume 03c8f375-59da-4fb6-b8a4-0adac54ef07a {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:27 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:27 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 Sep 30 19:56:27 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4598fe-face-4ca4-b36f-49e00a8718bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:27 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a 1073741824 Sep 30 19:56:27 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b819088-dd0d-41fa-80e5-1511fb476ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Volume volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 (7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97): created successfully Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b819088-dd0d-41fa-80e5-1511fb476ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Flow 'volume_create_manager' (c766cabe-7519-489c-ba21-2c324456a219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a6922209-1b18-4dae-bf71-c0f4d13c598f tempest-CinderUnicodeTest-703099025 None] Created volume successfully. Sep 30 19:56:27 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e" returned: 0 in 0.397s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:27 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e Sep 30 19:56:27 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:27 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615" returned: 0 in 0.410s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:27 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 Sep 30 19:56:27 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:27 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e" returned: 0 in 0.297s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:27 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Lock "cinder-quobyte-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e" released by "delete_volume" :: held 0.740s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a 1073741824" returned: 0 in 0.495s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:27 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a Sep 30 19:56:27 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:27 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Created reservations ['a8a80745-5646-44d5-87df-3484ff22ed82', '53c9c2f2-8896-4427-b3d2-42c01b9477bd', 'a8bef70b-a293-49a9-b961-9d74888cd666', '98fa9b65-d4de-4822-a79e-e7e10c1fe2cb'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:28 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:28 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:28 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3" returned: 0 in 0.449s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:28 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3 Sep 30 19:56:28 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:28 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a" returned: 0 in 0.364s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Attempting download of 727ee45e-7692-4586-b6f2-4331c7dbc3ee ((None, [{'url': 'file:///opt/stack/data/glance/images/727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'metadata': {}}])) to volume 03c8f375-59da-4fb6-b8a4-0adac54ef07a. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56f3986-44a1-4471-a034-732825b97743]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_727ee45e-7692-4586-b6f2-4331c7dbc3ee_yc0slq5e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:28 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615.300e0474-0169-44ea-8f78-e8ef9e9201f3" returned: 0 in 0.343s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:28 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.447s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-300e0474-0169-44ea-8f78-e8ef9e9201f3" released by "_delete_snapshot" :: held 1.793s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Deleted volume successfully. Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-2a4aae52-0c05-4a2a-b1a9-2ba449381615" released by "delete_snapshot" :: held 1.845s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:28 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_727ee45e-7692-4586-b6f2-4331c7dbc3ee_yc0slq5e Sep 30 19:56:28 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e6cfe787-dab7-4ae1-b168-bae765496786 tempest-ProjectReaderTests-557976045 None] Lock "cinder-8c167a0b-a1d4-4fe5-8fb6-0beeb457005e-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Created reservations ['8cd2bfaa-aa65-483c-b431-d82d39cfdb4d', '22a0d302-b3d8-4b43-a7bc-18a5e3bd6d85', 'cf12162b-9b7d-4442-99e4-5be41085990e', '41e35c87-86fb-49f8-b059-ae7582981edc'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:28 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Delete snapshot completed successfully. Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-80784e9e-914c-47f2-accf-0268e97fcbc9 tempest-ProjectReaderTests-576119329 None] Lock "cinder-300e0474-0169-44ea-8f78-e8ef9e9201f3-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:28 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-2a4aae52-0c05-4a2a-b1a9-2ba449381615-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_727ee45e-7692-4586-b6f2-4331c7dbc3ee_yc0slq5e" returned: 0 in 0.488s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_727ee45e-7692-4586-b6f2-4331c7dbc3ee_yc0slq5e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Lock "cinder-2a4aae52-0c05-4a2a-b1a9-2ba449381615-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Flow 'volume_create_manager' (d9967bae-bc22-4c35-9577-a502166d7b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:28 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85169e21-e554-4857-9548-6cbef3909052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85169e21-e554-4857-9548-6cbef3909052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1607717909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09666de-5511-4bd9-8744-e16e7a79eb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4137c1ec4f82411b9396bdae04f74c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:29Z,use_quota=True,user_id='4b6b07ef25d44dd9b74e2408df1a58de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ad01e2-7806-46d9-b5c2-ece9f559ff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ad01e2-7806-46d9-b5c2-ece9f559ff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad35be7-da60-44c9-9a09-d7fdf8a284b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad35be7-da60-44c9-9a09-d7fdf8a284b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09666de-5511-4bd9-8744-e16e7a79eb28', 'volume_name': 'volume-c09666de-5511-4bd9-8744-e16e7a79eb28', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35554fed-2d0e-45b6-9b28-96aad47e9754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35554fed-2d0e-45b6-9b28-96aad47e9754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_727ee45e-7692-4586-b6f2-4331c7dbc3ee_yc0slq5e Sep 30 19:56:29 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7777ed3c-7d52-41af-9c2e-0b5930f16068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Volume c09666de-5511-4bd9-8744-e16e7a79eb28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09666de-5511-4bd9-8744-e16e7a79eb28', 'volume_size': 1} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1607717909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09666de-5511-4bd9-8744-e16e7a79eb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4137c1ec4f82411b9396bdae04f74c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:29Z,use_quota=True,user_id='4b6b07ef25d44dd9b74e2408df1a58de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Creating volume c09666de-5511-4bd9-8744-e16e7a79eb28 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:29 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:29 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 1073741824 Sep 30 19:56:29 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Flow 'volume_create_manager' (b2dad287-e4d6-40e2-99e6-514bf81c7bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e8f417-e03f-49d9-815f-6a0bc5045ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-2a4aae52-0c05-4a2a-b1a9-2ba449381615" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e8f417-e03f-49d9-815f-6a0bc5045ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067406410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732114e9-a4c4-4585-b4ab-1144dcba0176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec99eee1fbb42ae9b2533ae3af65021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:29Z,use_quota=True,user_id='4ad3905701e44c30aa452f0f8b3ffeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230baeac-acbd-4d1b-9d6b-f840a7820c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230baeac-acbd-4d1b-9d6b-f840a7820c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54b92a8-0a5d-48cc-b3c9-9845bdaebfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54b92a8-0a5d-48cc-b3c9-9845bdaebfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732114e9-a4c4-4585-b4ab-1144dcba0176', 'volume_name': 'volume-732114e9-a4c4-4585-b4ab-1144dcba0176', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06dc249-35e8-4c0d-b3c3-1616ec71c315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06dc249-35e8-4c0d-b3c3-1616ec71c315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed0e69e-b9b7-4590-9a93-6ba357efbaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Volume 732114e9-a4c4-4585-b4ab-1144dcba0176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732114e9-a4c4-4585-b4ab-1144dcba0176', 'volume_size': 1} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-2a4aae52-0c05-4a2a-b1a9-2ba449381615" acquired by "delete_volume" :: waited 0.054s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12ffb86-9157-429d-b3e5-93543b6d211d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:29 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_727ee45e-7692-4586-b6f2-4331c7dbc3ee_yc0slq5e" returned: 1 in 0.382s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_727ee45e-7692-4586-b6f2-4331c7dbc3ee_yc0slq5e' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1ac6b7-dbec-437e-a63d-da73cd1ab966]: (4, 'raw') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:29 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 Sep 30 19:56:29 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:29 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD Sep 30 19:56:29 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:29 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 1073741824" returned: 0 in 0.454s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:29 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 Sep 30 19:56:29 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:29 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:29 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615" returned: 0 in 0.439s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:29 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615 Sep 30 19:56:29 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:29 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD Sep 30 19:56:29 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:29 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28" returned: 0 in 0.277s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067406410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732114e9-a4c4-4585-b4ab-1144dcba0176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec99eee1fbb42ae9b2533ae3af65021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:29Z,use_quota=True,user_id='4ad3905701e44c30aa452f0f8b3ffeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Creating volume 732114e9-a4c4-4585-b4ab-1144dcba0176 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:29 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7777ed3c-7d52-41af-9c2e-0b5930f16068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09666de-5511-4bd9-8744-e16e7a79eb28', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176 1073741824 Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1880ed74-3091-4be5-95a1-844698dff3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:29 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:29 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Volume volume-c09666de-5511-4bd9-8744-e16e7a79eb28 (c09666de-5511-4bd9-8744-e16e7a79eb28): created successfully Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1880ed74-3091-4be5-95a1-844698dff3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Flow 'volume_create_manager' (d9967bae-bc22-4c35-9577-a502166d7b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:29 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d2e75668-31e3-4369-a869-1dabb928f5d6 tempest-CinderUnicodeTest-703099025 None] Created volume successfully. Sep 30 19:56:29 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-2a4aae52-0c05-4a2a-b1a9-2ba449381615" returned: 0 in 0.306s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-2a4aae52-0c05-4a2a-b1a9-2ba449381615" released by "delete_volume" :: held 0.813s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Created reservations ['6554f6c0-5e08-4e21-9f4a-a3efb75cfee7', '678ae5b8-3ea1-44f3-b14f-4696116ef800', '3307b0a7-5af2-4caf-937d-04e173531b9d', 'a1f44f53-2531-4094-baf1-645b39d2a388'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:30 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] 727ee45e-7692-4586-b6f2-4331c7dbc3ee was raw, converting to qcow2 {{(pid=87426) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:30 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a Sep 30 19:56:30 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:30 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:30 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:30 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176 1073741824" returned: 0 in 0.492s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:30 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176 Sep 30 19:56:30 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:30 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Deleted volume successfully. Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-90a74888-c797-4add-9d9b-8bc3b94231f8 tempest-ProjectReaderTests-576119329 None] Lock "cinder-2a4aae52-0c05-4a2a-b1a9-2ba449381615-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:30 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a" returned: 0 in 0.511s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_727ee45e-7692-4586-b6f2-4331c7dbc3ee_4_5mohhjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:56:30 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:30 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a 1G Sep 30 19:56:30 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:30 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176" returned: 0 in 0.286s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed0e69e-b9b7-4590-9a93-6ba357efbaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732114e9-a4c4-4585-b4ab-1144dcba0176', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36d3c09-2661-4a37-886d-11a8ff0082aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:30 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Volume volume-732114e9-a4c4-4585-b4ab-1144dcba0176 (732114e9-a4c4-4585-b4ab-1144dcba0176): created successfully Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36d3c09-2661-4a37-886d-11a8ff0082aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Flow 'volume_create_manager' (b2dad287-e4d6-40e2-99e6-514bf81c7bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:30 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-34e56afa-cd7b-4ad1-846d-ff5d407fd36c tempest-ProjectReaderTests-557976045 None] Created volume successfully. Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Acquiring lock "cinder-732114e9-a4c4-4585-b4ab-1144dcba0176-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:30 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Lock "cinder-732114e9-a4c4-4585-b4ab-1144dcba0176-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:30 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a 1G" returned: 0 in 0.407s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Downloaded image 727ee45e-7692-4586-b6f2-4331c7dbc3ee ((None, [{'url': 'file:///opt/stack/data/glance/images/727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'metadata': {}}])) to volume 03c8f375-59da-4fb6-b8a4-0adac54ef07a successfully. {{(pid=87426) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Temporary image 727ee45e-7692-4586-b6f2-4331c7dbc3ee for user 65d2140e35944d3c81566fa0a4a00ccb is deleted. {{(pid=87426) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.volume_utils [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Marking volume 03c8f375-59da-4fb6-b8a4-0adac54ef07a as bootable. {{(pid=87426) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Acquiring lock "cinder-quobyte-732114e9-a4c4-4585-b4ab-1144dcba0176" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Lock "cinder-quobyte-732114e9-a4c4-4585-b4ab-1144dcba0176" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Copying metadata from image 727ee45e-7692-4586-b6f2-4331c7dbc3ee to 03c8f375-59da-4fb6-b8a4-0adac54ef07a. {{(pid=87426) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Creating volume glance metadata for volume 03c8f375-59da-4fb6-b8a4-0adac54ef07a backed by image 727ee45e-7692-4586-b6f2-4331c7dbc3ee with: {'image_id': '727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b165635b989aaa6852abe70312851e9b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87426) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e34033f-0ba3-482c-9df3-7955235b626d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Creating offline snapshot f06e6744-07b0-4d70-bb09-13534cf4e670 of volume c09666de-5511-4bd9-8744-e16e7a79eb28 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0949c09f-943b-489e-be9c-f1df0a56c143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a', 'volume_size': 1, 'image_id': '727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b165635b989aaa6852abe70312851e9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd986d8d22e344969abbe366a591cdf3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a61fe9692e687b9535971818f9b221e249698326602efdc3c2144257c1f157876ba1bc0141eecbf861df3b7c7c5d4c89071092c3f181ca4b48254613e1098b12', 'id': '727ee45e-7692-4586-b6f2-4331c7dbc3ee', 'created_at': datetime.datetime(2026, 9, 30, 17, 56, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 17, 56, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/727ee45e-7692-4586-b6f2-4331c7dbc3ee/file', 'properties': {}}, 'image_service': }' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f433030b-f2a1-4d60-ae84-7608bc0c8bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:31 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176 Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3f7124-5cb8-4250-8e66-5e1da7d89af8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:31 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:31 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Volume volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a (03c8f375-59da-4fb6-b8a4-0adac54ef07a): created successfully Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f433030b-f2a1-4d60-ae84-7608bc0c8bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Flow 'volume_create_manager' (5618a5d4-b08a-4f19-af1b-3a570aa6917f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0399eab3-184b-4865-a265-80b7e21f6b0e tempest-VolumeImageDependencyTests-1415233146 None] Created volume successfully. Sep 30 19:56:31 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 Sep 30 19:56:31 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:31 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176" returned: 0 in 0.467s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:31 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176 Sep 30 19:56:31 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:31 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28" returned: 0 in 0.424s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:31 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 1G Sep 30 19:56:31 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (526cdec3-7459-4df2-9140-5318b2b5debf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760f5bbc-7c25-4238-817d-fa294e5b94e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760f5bbc-7c25-4238-817d-fa294e5b94e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031678257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:32Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77bfbfa-b482-41a4-9f8b-0d20ed423a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77bfbfa-b482-41a4-9f8b-0d20ed423a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0180e2-8262-4f4b-9f1f-9bd44aab5be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0180e2-8262-4f4b-9f1f-9bd44aab5be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6', 'volume_name': 'volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307af59a-6466-4d27-9c0c-58d93cb264c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307af59a-6466-4d27-9c0c-58d93cb264c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179f248f-f2d1-40f1-884b-355db2e87280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:31 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Volume 87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6', 'volume_size': 1} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:31 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-732114e9-a4c4-4585-b4ab-1144dcba0176" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Lock "cinder-quobyte-732114e9-a4c4-4585-b4ab-1144dcba0176" released by "delete_volume" :: held 0.809s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Created reservations ['7a14dba8-50a2-461d-aba9-aa00438c6f4d', '8e792029-6543-453a-b181-e2c1b36d06af', 'd132e81e-156f-4665-b7c8-0178e4c856b0', '30b32376-7645-4cab-8059-578f1f0d5ab8'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Acquiring lock "cinder-03c8f375-59da-4fb6-b8a4-0adac54ef07a-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:31 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Lock "cinder-03c8f375-59da-4fb6-b8a4-0adac54ef07a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Acquiring lock "cinder-quobyte-03c8f375-59da-4fb6-b8a4-0adac54ef07a" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Lock "cinder-quobyte-03c8f375-59da-4fb6-b8a4-0adac54ef07a" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e382441-5e7f-46f1-8db3-b83ead283a34]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:32 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:32 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:32 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 1G" returned: 0 in 0.569s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09666de-5511-4bd9-8744-e16e7a79eb28 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:32 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a Sep 30 19:56:32 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:32 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09666de-5511-4bd9-8744-e16e7a79eb28 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 Sep 30 19:56:32 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:32 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.319s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:32 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Deleted volume successfully. Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8d1ed130-6a9d-4281-905a-cafc901dd346 tempest-ProjectReaderTests-557976045 None] Lock "cinder-732114e9-a4c4-4585-b4ab-1144dcba0176-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:32 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a" returned: 0 in 0.460s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:32 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09666de-5511-4bd9-8744-e16e7a79eb28 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670" returned: 0 in 0.376s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:32 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 is being set with open permissions: ugo+rw Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:32 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a Sep 30 19:56:32 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:32 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 Sep 30 19:56:32 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:32 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-03c8f375-59da-4fb6-b8a4-0adac54ef07a" returned: 0 in 0.280s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Lock "cinder-quobyte-03c8f375-59da-4fb6-b8a4-0adac54ef07a" released by "delete_volume" :: held 0.818s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:32 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:32 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Created reservations ['089f261d-36dc-4b48-9143-c61cec05bfef', '90644994-74e3-4dcc-96a9-4e456ca578d5', 'ec4153cc-551a-4515-89fe-e12e2dca75d6', '4da1fada-f651-45b4-9078-c6027e88b1ef'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:32 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.info Sep 30 19:56:32 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:33 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:33 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:33 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.info" returned: 0 in 0.372s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:33 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.info is being set with open permissions: ugo+rw Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:33 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.info Sep 30 19:56:33 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:33 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.342s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:33 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Deleted volume successfully. Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8123d0be-4d65-4e1c-87ca-76656ba0b828 tempest-VolumeImageDependencyTests-1415233146 None] Lock "cinder-03c8f375-59da-4fb6-b8a4-0adac54ef07a-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:33 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.info" returned: 0 in 0.323s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.855s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031678257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dcd6bff1394e129c72d1394464cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:32Z,use_quota=True,user_id='b09a448136974c19b3fe0016026c6ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Creating volume 87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:33 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:33 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 1073741824 Sep 30 19:56:33 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:33 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-619482b6-9e52-4833-b1c1-37964642207c tempest-CinderUnicodeTest-703099025 None] Create snapshot completed successfully Sep 30 19:56:34 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 1073741824" returned: 0 in 0.535s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:34 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 Sep 30 19:56:34 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Acquiring lock "cinder-f06e6744-07b0-4d70-bb09-13534cf4e670-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Lock "cinder-f06e6744-07b0-4d70-bb09-13534cf4e670-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Acquiring lock "cinder-quobyte-c09666de-5511-4bd9-8744-e16e7a79eb28" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Lock "cinder-quobyte-c09666de-5511-4bd9-8744-e16e7a79eb28" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Acquiring lock "cinder-quobyte-f06e6744-07b0-4d70-bb09-13534cf4e670" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Lock "cinder-quobyte-f06e6744-07b0-4d70-bb09-13534cf4e670" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Deleting offline snapshot f06e6744-07b0-4d70-bb09-13534cf4e670 of volume c09666de-5511-4bd9-8744-e16e7a79eb28 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] snapshot_file for this snap is: volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[af821557-9ec3-433c-b9b1-954c62d713f5]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:34 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" returned: 0 in 0.318s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179f248f-f2d1-40f1-884b-355db2e87280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e386e60-1abb-40f3-ae8e-52d5c7605fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:34 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Volume volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 (87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6): created successfully Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e386e60-1abb-40f3-ae8e-52d5c7605fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Flow 'volume_create_manager' (526cdec3-7459-4df2-9140-5318b2b5debf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:34 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-630fa811-3037-4031-abcc-fb3779c609f2 tempest-ProjectReaderTests-576119329 None] Created volume successfully. Sep 30 19:56:34 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 Sep 30 19:56:34 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:34 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670" returned: 0 in 0.485s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c09666de-5511-4bd9-8744-e16e7a79eb28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Creating offline snapshot 844134ad-14f8-42c9-9f33-4b93af1868b3 of volume 87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2465b1d-b4ee-4930-a179-ee7722397842]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf9302f-2f1d-4f76-a140-8daeb546a4dd]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:35 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 Sep 30 19:56:35 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:35 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 Sep 30 19:56:35 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:35 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28" returned: 0 in 0.401s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:35 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" returned: 0 in 0.402s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:35 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 Sep 30 19:56:35 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:35 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 1G Sep 30 19:56:35 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:35 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670" returned: 0 in 0.392s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:35 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670 Sep 30 19:56:35 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:35 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 1G" returned: 0 in 0.478s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:35 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 Sep 30 19:56:35 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:36 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28.f06e6744-07b0-4d70-bb09-13534cf4e670" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Lock "cinder-quobyte-f06e6744-07b0-4d70-bb09-13534cf4e670" released by "_delete_snapshot" :: held 1.688s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Lock "cinder-quobyte-c09666de-5511-4bd9-8744-e16e7a79eb28" released by "delete_snapshot" :: held 1.720s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Created reservations ['67a62df1-15c6-49d4-b3f1-00717226885c', '4097c9ed-8930-4eac-838f-fff71d940169', '8f394623-ee9b-4b31-9f1e-a38ce681486d', 'db42aad4-a1d2-4844-842d-0812f979719b'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:36 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Delete snapshot completed successfully. Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-3d6246be-9f18-4fd2-b6ad-e1d2c7a16cae tempest-CinderUnicodeTest-703099025 None] Lock "cinder-f06e6744-07b0-4d70-bb09-13534cf4e670-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:36 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3" returned: 0 in 0.361s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:36 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 is being set with open permissions: ugo+rw Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:36 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 Sep 30 19:56:36 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:36 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3" returned: 0 in 0.252s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Acquiring lock "cinder-c09666de-5511-4bd9-8744-e16e7a79eb28-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:36 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.info Sep 30 19:56:36 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Lock "cinder-c09666de-5511-4bd9-8744-e16e7a79eb28-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Acquiring lock "cinder-quobyte-c09666de-5511-4bd9-8744-e16e7a79eb28" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Lock "cinder-quobyte-c09666de-5511-4bd9-8744-e16e7a79eb28" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f9b6ca-0159-4fb1-9484-74fa3cf18416]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:36 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 Sep 30 19:56:36 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:36 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.info" returned: 0 in 0.317s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:36 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.info is being set with open permissions: ugo+rw Sep 30 19:56:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:36 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.info Sep 30 19:56:36 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:37 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28" returned: 0 in 0.415s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:37 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.info" returned: 0 in 0.292s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:37 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28 Sep 30 19:56:37 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:37 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-32ac068b-d584-4a8c-aaf4-16d98580bc4b tempest-ProjectReaderTests-576119329 None] Create snapshot completed successfully Sep 30 19:56:37 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c09666de-5511-4bd9-8744-e16e7a79eb28" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Lock "cinder-quobyte-c09666de-5511-4bd9-8744-e16e7a79eb28" released by "delete_volume" :: held 0.760s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Created reservations ['dad12b9b-c4e0-4af8-949d-244538683be2', 'b54243a7-6a9d-4976-a026-ebbbbe31dbc8', '769dbe5f-8dfa-4c51-b562-837db38208b2', '340975fb-1030-4c02-af86-7b65f1af9874'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:37 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:37 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Acquiring lock "cinder-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Lock "cinder-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:37 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Acquiring lock "cinder-quobyte-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.267s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:37 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Deleted volume successfully. Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Lock "cinder-quobyte-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-07c7f2e1-46fd-44fa-bb4a-8452dfd5e171 tempest-CinderUnicodeTest-703099025 None] Lock "cinder-c09666de-5511-4bd9-8744-e16e7a79eb28-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d24af2-c5c7-498e-8343-9842b7aa86f7]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:38 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 Sep 30 19:56:38 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-844134ad-14f8-42c9-9f33-4b93af1868b3-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Lock "cinder-844134ad-14f8-42c9-9f33-4b93af1868b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-844134ad-14f8-42c9-9f33-4b93af1868b3" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-844134ad-14f8-42c9-9f33-4b93af1868b3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Deleting offline snapshot 844134ad-14f8-42c9-9f33-4b93af1868b3 of volume 87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] snapshot_file for this snap is: volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3187a7a0-d794-4229-9c61-6a8ca63ba34d]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:38 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97" returned: 0 in 0.440s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:38 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97 Sep 30 19:56:38 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:38 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 Sep 30 19:56:38 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:38 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97" returned: 0 in 0.274s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Lock "cinder-quobyte-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97" released by "delete_volume" :: held 0.765s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Created reservations ['5b751a31-02d1-4c66-a475-35a9d07311cb', '6dbf8ff6-ea83-40f2-9cb5-077786cf4ba2', 'acb3f28b-747e-41f8-b391-04cd2dee9f74', '52a834cd-6d8d-4429-90a2-b038b39e0ec3'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:38 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3" returned: 0 in 0.418s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fb7c56-a2c8-4b8a-a835-9e111edced76]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:38 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:38 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:38 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 Sep 30 19:56:38 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:39 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.314s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:39 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Deleted volume successfully. Sep 30 19:56:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4168229a-d18a-4b1d-b0a0-8ee36600bf70 tempest-CinderUnicodeTest-703099025 None] Lock "cinder-7f4dfade-2ac7-4ce1-bed1-cdfc551b4e97-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:39 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" returned: 0 in 0.477s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:39 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 Sep 30 19:56:39 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:39 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3" returned: 0 in 0.413s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:39 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3 Sep 30 19:56:39 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:39 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6.844134ad-14f8-42c9-9f33-4b93af1868b3" returned: 0 in 0.288s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-844134ad-14f8-42c9-9f33-4b93af1868b3" released by "_delete_snapshot" :: held 1.723s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" released by "delete_snapshot" :: held 1.756s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Created reservations ['3219f61a-7426-455b-b958-5682bd6b39e7', '54cfe25b-ec42-4d77-8c96-83011320a0f2', 'f6175ab0-370a-4f2c-8549-ad05db202463', '802fd81a-4e4b-4392-92c4-0b649fec9fd6'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:40 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Delete snapshot completed successfully. Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-8fdf2ecf-3559-41d9-a55a-0ac8a9b05da3 tempest-ProjectReaderTests-576119329 None] Lock "cinder-844134ad-14f8-42c9-9f33-4b93af1868b3-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Lock "cinder-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Acquiring lock "cinder-quobyte-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e0e12e-ea7d-40a6-a56a-0d639a527d21]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:40 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 Sep 30 19:56:40 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:40 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" returned: 0 in 0.406s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:41 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6 Sep 30 19:56:41 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:41 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Lock "cinder-quobyte-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6" released by "delete_volume" :: held 0.766s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Created reservations ['18a28c45-c154-4b0d-a7b6-809ee80e8732', '4bfddd93-9a89-4878-9cf7-6ad8ce3a8eeb', 'c2d997f5-7a76-406e-8cca-2549cb837b21', '712c9be8-56f4-406e-a673-9054b65485c3'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:41 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:41 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:41 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.292s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:41 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Deleted volume successfully. Sep 30 19:56:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-e2b6da38-94d4-41df-be03-79fe0c70bb1c tempest-ProjectReaderTests-576119329 None] Lock "cinder-87cb7ef5-ce7d-485f-8f6f-6efb2d4982f6-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (1fecf1ae-ef39-4b6f-9273-6cec5eaf995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3cda49-8dc5-4aba-9049-8cdcd61f5e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3cda49-8dc5-4aba-9049-8cdcd61f5e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995504217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde14074-353d-4295-b5bb-470b094588c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:44Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2ad4e9-bcef-42ad-844f-76e11d7a8139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2ad4e9-bcef-42ad-844f-76e11d7a8139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fefcc06-7371-41da-9746-fa2d2098ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fefcc06-7371-41da-9746-fa2d2098ce23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde14074-353d-4295-b5bb-470b094588c6', 'volume_name': 'volume-bde14074-353d-4295-b5bb-470b094588c6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d2b70f-9927-40bf-9b19-957b5b380bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d2b70f-9927-40bf-9b19-957b5b380bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a8bc28-3e3d-4318-a580-08af0f2dc808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:43 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Volume bde14074-353d-4295-b5bb-470b094588c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde14074-353d-4295-b5bb-470b094588c6', 'volume_size': 1} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995504217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde14074-353d-4295-b5bb-470b094588c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:44Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Creating volume bde14074-353d-4295-b5bb-470b094588c6 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:43 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:43 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 1073741824 Sep 30 19:56:43 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:44 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 1073741824" returned: 0 in 0.535s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:44 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 Sep 30 19:56:44 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:44 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6" returned: 0 in 0.300s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a8bc28-3e3d-4318-a580-08af0f2dc808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde14074-353d-4295-b5bb-470b094588c6', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea596c39-aa30-4a11-9c8a-d10a2416ffe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:44 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Volume volume-bde14074-353d-4295-b5bb-470b094588c6 (bde14074-353d-4295-b5bb-470b094588c6): created successfully Sep 30 19:56:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea596c39-aa30-4a11-9c8a-d10a2416ffe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (1fecf1ae-ef39-4b6f-9273-6cec5eaf995a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:44 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-173913d3-b81d-4250-909e-1918473643fa tempest-ProjectMemberTests-1043366750 None] Created volume successfully. Sep 30 19:56:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Creating offline snapshot 2a73b891-b808-49df-a04a-db580f302941 of volume bde14074-353d-4295-b5bb-470b094588c6 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:56:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dce3627-bd18-427f-ba87-bd9e54632491]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:46 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 Sep 30 19:56:46 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:46 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6" returned: 0 in 0.414s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:46 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 1G Sep 30 19:56:46 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:47 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 1G" returned: 0 in 0.445s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde14074-353d-4295-b5bb-470b094588c6 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:47 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde14074-353d-4295-b5bb-470b094588c6 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 Sep 30 19:56:47 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:47 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde14074-353d-4295-b5bb-470b094588c6 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941" returned: 0 in 0.331s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:47 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 is being set with open permissions: ugo+rw Sep 30 19:56:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:47 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 Sep 30 19:56:47 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:47 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941" returned: 0 in 0.261s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:47 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.info Sep 30 19:56:47 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:48 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.info" returned: 0 in 0.307s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:48 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.info is being set with open permissions: ugo+rw Sep 30 19:56:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:48 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.info Sep 30 19:56:48 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:48 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.info" returned: 0 in 0.290s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-e0b28cd7-f7dc-46a1-b3b6-891d5cf87329 tempest-ProjectMemberTests-1043366750 None] Create snapshot completed successfully Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-2a73b891-b808-49df-a04a-db580f302941-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-2a73b891-b808-49df-a04a-db580f302941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-bde14074-353d-4295-b5bb-470b094588c6" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-bde14074-353d-4295-b5bb-470b094588c6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-2a73b891-b808-49df-a04a-db580f302941" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-2a73b891-b808-49df-a04a-db580f302941" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Deleting offline snapshot 2a73b891-b808-49df-a04a-db580f302941 of volume bde14074-353d-4295-b5bb-470b094588c6 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] snapshot_file for this snap is: volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f85c782-8fbf-42a9-841f-a28076cda613]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:49 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 Sep 30 19:56:49 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:49 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941" returned: 0 in 0.416s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bde14074-353d-4295-b5bb-470b094588c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3abd843-7162-4f32-8354-625a817077cb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:50 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 Sep 30 19:56:50 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:50 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6" returned: 0 in 0.493s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:50 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 Sep 30 19:56:50 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:50 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941" returned: 0 in 0.418s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:50 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941 Sep 30 19:56:50 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:51 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6.2a73b891-b808-49df-a04a-db580f302941" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-2a73b891-b808-49df-a04a-db580f302941" released by "_delete_snapshot" :: held 1.775s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-bde14074-353d-4295-b5bb-470b094588c6" released by "delete_snapshot" :: held 1.799s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Created reservations ['7cb10858-7d8c-4816-a2c0-a9d3b59a554e', '28d13a68-7521-4783-bbda-36e85f7e2b15', '50630c8b-2b67-4bcc-a448-4ade1062e19e', '9a19e7bb-c464-4f47-8d6a-eb30cff462fd'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:51 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Delete snapshot completed successfully. Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9c6513e0-7377-4515-b5b2-fd0d0e720f21 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-2a73b891-b808-49df-a04a-db580f302941-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-bde14074-353d-4295-b5bb-470b094588c6-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Lock "cinder-bde14074-353d-4295-b5bb-470b094588c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-bde14074-353d-4295-b5bb-470b094588c6" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-bde14074-353d-4295-b5bb-470b094588c6" acquired by "delete_volume" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b242e52-4629-4f5a-9ccf-ee430cb0884c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:51 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 Sep 30 19:56:51 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:52 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6" returned: 0 in 0.417s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:52 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6 Sep 30 19:56:52 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:52 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-bde14074-353d-4295-b5bb-470b094588c6" returned: 0 in 0.293s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-bde14074-353d-4295-b5bb-470b094588c6" released by "delete_volume" :: held 0.798s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Created reservations ['097bdb69-3090-4cf2-9ad5-a43159612075', '1cb15758-185f-4b75-8eb0-93993d4b2050', 'ad777492-1c22-49fe-a70d-4bc28b0b902b', '5963744f-ea55-4b77-a31f-d120b9f08f8a'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:52 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:56:52 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:52 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.316s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:56:52 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Deleted volume successfully. Sep 30 19:56:52 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-d6664b5d-8c0f-4c6e-a412-ed8cfdebb60a tempest-ProjectMemberTests-1043366750 None] Lock "cinder-bde14074-353d-4295-b5bb-470b094588c6-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (1cd41b85-b0dc-4580-8b6d-4ab43be083f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5559efa3-9190-4b50-9b91-06271a720c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5559efa3-9190-4b50-9b91-06271a720c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-413511890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5daf3f9-440c-4358-bb63-bc73880e275e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:53Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4fd50b-22fa-4aaa-999e-681c6ba338ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4fd50b-22fa-4aaa-999e-681c6ba338ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed2ef67-6450-421f-9802-e516bec326dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed2ef67-6450-421f-9802-e516bec326dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5daf3f9-440c-4358-bb63-bc73880e275e', 'volume_name': 'volume-a5daf3f9-440c-4358-bb63-bc73880e275e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578c95af-d981-4664-84bc-9239b88496be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578c95af-d981-4664-84bc-9239b88496be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0f4925-655e-4527-b83c-f9df15004a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:53 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Volume a5daf3f9-440c-4358-bb63-bc73880e275e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5daf3f9-440c-4358-bb63-bc73880e275e', 'volume_size': 1} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-413511890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5daf3f9-440c-4358-bb63-bc73880e275e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:53Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Creating volume a5daf3f9-440c-4358-bb63-bc73880e275e {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:53 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:53 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e 1073741824 Sep 30 19:56:53 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:54 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e 1073741824" returned: 0 in 0.578s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:54 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e Sep 30 19:56:54 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:54 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e" returned: 0 in 0.287s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:54 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0f4925-655e-4527-b83c-f9df15004a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5daf3f9-440c-4358-bb63-bc73880e275e', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03014edc-0793-4dc1-b66a-909af04f6ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:54 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Volume volume-a5daf3f9-440c-4358-bb63-bc73880e275e (a5daf3f9-440c-4358-bb63-bc73880e275e): created successfully Sep 30 19:56:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03014edc-0793-4dc1-b66a-909af04f6ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:54 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (1cd41b85-b0dc-4580-8b6d-4ab43be083f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:54 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-19bce854-c340-4c26-a17f-e8e3d88332a5 tempest-ProjectMemberTests-1043366750 None] Created volume successfully. Sep 30 19:56:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:55 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Creating offline snapshot 437abd28-b717-41ae-bef6-5c43cf29be69 of volume a5daf3f9-440c-4358-bb63-bc73880e275e {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:56:55 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f597fee9-3e8e-4a98-b7fa-cf67ba5a2002]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:55 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e Sep 30 19:56:55 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:56 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e" returned: 0 in 0.406s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:56 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 1G Sep 30 19:56:56 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:56 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 1G" returned: 0 in 0.457s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5daf3f9-440c-4358-bb63-bc73880e275e -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:56 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5daf3f9-440c-4358-bb63-bc73880e275e -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 Sep 30 19:56:56 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:56:57 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Flow 'volume_create_manager' (60c0221a-5c00-4ba0-84e8-a57fecc13255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f321ea7a-faf3-4cdb-85eb-10a022ab2acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5daf3f9-440c-4358-bb63-bc73880e275e -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69" returned: 0 in 0.380s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:57 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 is being set with open permissions: ugo+rw Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:57 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 Sep 30 19:56:57 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f321ea7a-faf3-4cdb-85eb-10a022ab2acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206985384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9edb91-3bdc-419e-9209-1610f1163122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f890407595e44bb87aeeffeebdda740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:57Z,use_quota=True,user_id='aef7332a81d24fa1b38793e15ca13f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9561a8-fad5-47d5-be38-ec3da1ef19de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9561a8-fad5-47d5-be38-ec3da1ef19de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ca38c1-fd6b-419f-8b7f-9913f66e74a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ca38c1-fd6b-419f-8b7f-9913f66e74a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9edb91-3bdc-419e-9209-1610f1163122', 'volume_name': 'volume-6f9edb91-3bdc-419e-9209-1610f1163122', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0360a76f-e5e8-4ef6-b746-d4d6c594345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0360a76f-e5e8-4ef6-b746-d4d6c594345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa234b96-9bd6-4168-926a-9d8c65389c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Volume 6f9edb91-3bdc-419e-9209-1610f1163122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9edb91-3bdc-419e-9209-1610f1163122', 'volume_size': 1} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:57 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69" returned: 0 in 0.267s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:57 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.info Sep 30 19:56:57 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:57 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.info" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:57 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.info is being set with open permissions: ugo+rw Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:57 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.info Sep 30 19:56:57 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:57 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.info" returned: 0 in 0.264s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206985384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9edb91-3bdc-419e-9209-1610f1163122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f890407595e44bb87aeeffeebdda740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:56:57Z,use_quota=True,user_id='aef7332a81d24fa1b38793e15ca13f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Creating volume 6f9edb91-3bdc-419e-9209-1610f1163122 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:56:57 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:56:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:57 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122 1073741824 Sep 30 19:56:57 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:57 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-be433652-e3c5-45e9-91fe-2295114fe318 tempest-ProjectMemberTests-1043366750 None] Create snapshot completed successfully Sep 30 19:56:58 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122 1073741824" returned: 0 in 0.476s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:58 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122 Sep 30 19:56:58 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:58 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122" returned: 0 in 0.252s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa234b96-9bd6-4168-926a-9d8c65389c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9edb91-3bdc-419e-9209-1610f1163122', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6368043-c50d-41f9-a252-a6f90b0f987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:56:58 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Volume volume-6f9edb91-3bdc-419e-9209-1610f1163122 (6f9edb91-3bdc-419e-9209-1610f1163122): created successfully Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6368043-c50d-41f9-a252-a6f90b0f987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Flow 'volume_create_manager' (60c0221a-5c00-4ba0-84e8-a57fecc13255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:56:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-12cb9d13-1dcf-485d-9cf4-7794b271947c tempest-ProjectReaderTests-782985012 None] Created volume successfully. Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-437abd28-b717-41ae-bef6-5c43cf29be69-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-437abd28-b717-41ae-bef6-5c43cf29be69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-a5daf3f9-440c-4358-bb63-bc73880e275e" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-a5daf3f9-440c-4358-bb63-bc73880e275e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-437abd28-b717-41ae-bef6-5c43cf29be69" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:58 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-437abd28-b717-41ae-bef6-5c43cf29be69" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Deleting offline snapshot 437abd28-b717-41ae-bef6-5c43cf29be69 of volume a5daf3f9-440c-4358-bb63-bc73880e275e {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] snapshot_file for this snap is: volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[279aa567-804e-4915-8737-88ddd0e2946a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:59 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 Sep 30 19:56:59 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Acquiring lock "cinder-6f9edb91-3bdc-419e-9209-1610f1163122-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Lock "cinder-6f9edb91-3bdc-419e-9209-1610f1163122-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:59 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69" returned: 0 in 0.464s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5daf3f9-440c-4358-bb63-bc73880e275e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Acquiring lock "cinder-quobyte-6f9edb91-3bdc-419e-9209-1610f1163122" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c941a77c-7a6a-49d9-b150-320142dcfd57]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Lock "cinder-quobyte-6f9edb91-3bdc-419e-9209-1610f1163122" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[376f92a4-e311-498b-84a5-c6ffbd678d13]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:56:59 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e Sep 30 19:56:59 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:59 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122 Sep 30 19:56:59 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:56:59 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e" returned: 0 in 0.403s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:56:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:00 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 Sep 30 19:57:00 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:00 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122" returned: 0 in 0.459s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:00 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122 Sep 30 19:57:00 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:00 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-6f9edb91-3bdc-419e-9209-1610f1163122" returned: 0 in 0.268s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Lock "cinder-quobyte-6f9edb91-3bdc-419e-9209-1610f1163122" released by "delete_volume" :: held 0.782s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:00 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69" returned: 0 in 0.401s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:00 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69 Sep 30 19:57:00 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Created reservations ['ed822f02-eb67-49a6-8441-9bf5b8cd9b0d', '4d49035a-b536-4b1f-8845-afd596c1dde5', '9184501e-7865-459a-ab65-2f991b3562b8', 'f1f1a17d-f3be-4111-ae67-5bcab3a8a2a9'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:00 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:00 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:00 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e.437abd28-b717-41ae-bef6-5c43cf29be69" returned: 0 in 0.277s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-437abd28-b717-41ae-bef6-5c43cf29be69" released by "_delete_snapshot" :: held 1.704s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-a5daf3f9-440c-4358-bb63-bc73880e275e" released by "delete_snapshot" :: held 1.736s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Created reservations ['b6cfc0e8-fafc-43ef-9055-24a188a0c73a', 'e0654203-37fc-45b0-a66b-d9423bbef25f', 'a5d079fa-d2a7-4c44-8506-d308863d4e82', '5e3a4f06-a7b3-4610-8589-52b36b5cfc90'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:00 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.297s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Deleted volume successfully. Sep 30 19:57:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Delete snapshot completed successfully. Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-83027974-f698-4443-9087-65b1612cd5bd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-437abd28-b717-41ae-bef6-5c43cf29be69-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-2daba24c-640b-41b1-aaa3-c20350f6c8a1 tempest-ProjectReaderTests-782985012 None] Lock "cinder-6f9edb91-3bdc-419e-9209-1610f1163122-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Flow 'volume_create_manager' (d48d9224-acea-4bff-bf5b-c725474b4cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f55732-fb7a-4524-8d97-699596adcd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-a5daf3f9-440c-4358-bb63-bc73880e275e-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f55732-fb7a-4524-8d97-699596adcd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849712153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39cdcfa-dab8-40e1-8e2e-919b08e0b565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f890407595e44bb87aeeffeebdda740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:01Z,use_quota=True,user_id='aef7332a81d24fa1b38793e15ca13f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db50a9aa-d645-42c7-a461-1479e8e90231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db50a9aa-d645-42c7-a461-1479e8e90231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fad021-cbd6-4a8b-87e2-008e3b943d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fad021-cbd6-4a8b-87e2-008e3b943d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f39cdcfa-dab8-40e1-8e2e-919b08e0b565', 'volume_name': 'volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd92b01-ed61-4ee3-bb0d-1e3c9a4bbe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd92b01-ed61-4ee3-bb0d-1e3c9a4bbe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d53c00-89fb-42b3-99e1-90ef9c4b1522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:01 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Volume f39cdcfa-dab8-40e1-8e2e-919b08e0b565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565', 'volume_size': 1} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849712153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39cdcfa-dab8-40e1-8e2e-919b08e0b565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f890407595e44bb87aeeffeebdda740',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:01Z,use_quota=True,user_id='aef7332a81d24fa1b38793e15ca13f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Creating volume f39cdcfa-dab8-40e1-8e2e-919b08e0b565 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:01 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-a5daf3f9-440c-4358-bb63-bc73880e275e-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:01 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 1073741824 Sep 30 19:57:01 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-a5daf3f9-440c-4358-bb63-bc73880e275e" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-a5daf3f9-440c-4358-bb63-bc73880e275e" acquired by "delete_volume" :: waited 0.040s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce8eaf2-4327-478d-8c38-c9b2cc9b9458]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:01 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e Sep 30 19:57:01 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:01 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 1073741824" returned: 0 in 0.579s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:01 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e" returned: 0 in 0.431s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:01 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 Sep 30 19:57:01 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:01 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e Sep 30 19:57:01 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:02 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565" returned: 0 in 0.306s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d53c00-89fb-42b3-99e1-90ef9c4b1522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdddbb0-7fff-453d-83c9-4553365c3794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:02 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-a5daf3f9-440c-4358-bb63-bc73880e275e" returned: 0 in 0.314s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:02 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Volume volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 (f39cdcfa-dab8-40e1-8e2e-919b08e0b565): created successfully Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdddbb0-7fff-453d-83c9-4553365c3794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Flow 'volume_create_manager' (d48d9224-acea-4bff-bf5b-c725474b4cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-a5daf3f9-440c-4358-bb63-bc73880e275e" released by "delete_volume" :: held 0.852s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:02 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-32471e51-8177-4a16-9fdd-677ba4182854 tempest-ProjectReaderTests-782985012 None] Created volume successfully. Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Created reservations ['039fe6c1-ca04-440a-83a9-04dd45ef7041', 'ea1632c9-2704-4c95-94a7-a84586157d28', '8632e7cf-fde7-439f-9d41-f44983ed9009', 'f6d9c517-986e-4e99-9082-236eef9d61c1'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:02 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:02 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:02 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.271s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:02 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Deleted volume successfully. Sep 30 19:57:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-02c5ae0c-92dd-461f-a1ef-0c492e652241 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-a5daf3f9-440c-4358-bb63-bc73880e275e-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Acquiring lock "cinder-f39cdcfa-dab8-40e1-8e2e-919b08e0b565-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Lock "cinder-f39cdcfa-dab8-40e1-8e2e-919b08e0b565-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Acquiring lock "cinder-quobyte-f39cdcfa-dab8-40e1-8e2e-919b08e0b565" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Lock "cinder-quobyte-f39cdcfa-dab8-40e1-8e2e-919b08e0b565" acquired by "delete_volume" :: waited 0.031s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:03 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a07636-fad9-4fa9-a4fd-0a3d5f95cb0b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:03 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 Sep 30 19:57:03 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:03 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565" returned: 0 in 0.513s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:04 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565 Sep 30 19:57:04 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (b20dabfa-122b-423a-98bd-e69177909890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49002a8d-1314-4ed7-bc33-976e7d37d18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49002a8d-1314-4ed7-bc33-976e7d37d18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424644283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18578a4-c3e9-4153-a766-d3ca0123a4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:04Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d49a75a-f071-43e3-8479-eb47f8abd400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d49a75a-f071-43e3-8479-eb47f8abd400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1819d1ab-5d79-41f7-994a-211ff48ab564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1819d1ab-5d79-41f7-994a-211ff48ab564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c18578a4-c3e9-4153-a766-d3ca0123a4a0', 'volume_name': 'volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82c22b5-7aa0-49f4-98f8-07321921d59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82c22b5-7aa0-49f4-98f8-07321921d59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17830caa-555e-4f82-90ad-70c35dbe9b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:04 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Volume c18578a4-c3e9-4153-a766-d3ca0123a4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0', 'volume_size': 1} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424644283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18578a4-c3e9-4153-a766-d3ca0123a4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:04Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Creating volume c18578a4-c3e9-4153-a766-d3ca0123a4a0 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:04 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:04 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 1073741824 Sep 30 19:57:04 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:04 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-f39cdcfa-dab8-40e1-8e2e-919b08e0b565" returned: 0 in 0.344s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Lock "cinder-quobyte-f39cdcfa-dab8-40e1-8e2e-919b08e0b565" released by "delete_volume" :: held 0.926s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Created reservations ['f580e75f-ff0b-4849-a9b0-103d441d655a', 'd7a1271c-0293-4b1c-a94b-d011475f6204', '6c9e9bf6-e12f-40ca-a86d-9bb866857a21', '256fe73b-46b4-46c1-bf5f-0f842f39534b'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:04 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:04 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:04 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 1073741824" returned: 0 in 0.524s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:04 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.295s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:04 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Deleted volume successfully. Sep 30 19:57:04 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 Sep 30 19:57:04 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:04 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a33b7a53-be47-4150-856d-392078f43054 tempest-ProjectReaderTests-782985012 None] Lock "cinder-f39cdcfa-dab8-40e1-8e2e-919b08e0b565-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:05 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:05 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:57:05 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17830caa-555e-4f82-90ad-70c35dbe9b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f84f37-6394-4ba8-93a8-f61da25f2ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:05 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Volume volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 (c18578a4-c3e9-4153-a766-d3ca0123a4a0): created successfully Sep 30 19:57:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f84f37-6394-4ba8-93a8-f61da25f2ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:05 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (b20dabfa-122b-423a-98bd-e69177909890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:05 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-97abfe11-4668-46e7-958b-aa8972e5b169 tempest-ProjectMemberTests-1043366750 None] Created volume successfully. Sep 30 19:57:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:06 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Creating offline snapshot ace8aac0-9cc3-448a-b873-01ac70c5ec1e of volume c18578a4-c3e9-4153-a766-d3ca0123a4a0 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:57:06 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[487ed024-6c82-4ec5-87c3-abc7d1ec224c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:06 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 Sep 30 19:57:06 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:06 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0" returned: 0 in 0.486s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:06 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:06 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e 1G Sep 30 19:57:06 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:07 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e 1G" returned: 0 in 0.552s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:07 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e Sep 30 19:57:07 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Flow 'volume_create_manager' (ed29ce76-4965-47d3-a676-dc299b109140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3387fdd-70c2-42d0-a096-a8285616bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3387fdd-70c2-42d0-a096-a8285616bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1758167960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb20f48-0059-417f-a169-80a9ea5cdca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20c16f891c5468882084c62fa4c43d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:08Z,use_quota=True,user_id='91ec335888d9495bba0f7fa2d169b6c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946157e9-6ec2-42b1-8497-78dcbd22499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946157e9-6ec2-42b1-8497-78dcbd22499d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc7b542-53fa-46b4-81bd-dcb5e7e97a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc7b542-53fa-46b4-81bd-dcb5e7e97a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb20f48-0059-417f-a169-80a9ea5cdca9', 'volume_name': 'volume-7eb20f48-0059-417f-a169-80a9ea5cdca9', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ae257b-72f5-46ac-a835-83fa2f46f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ae257b-72f5-46ac-a835-83fa2f46f324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bf9bf2-00a6-4c55-99d4-644b907cb656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:07 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Volume 7eb20f48-0059-417f-a169-80a9ea5cdca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb20f48-0059-417f-a169-80a9ea5cdca9', 'volume_size': 1} Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:07 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e" returned: 0 in 0.309s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:07 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e is being set with open permissions: ugo+rw Sep 30 19:57:07 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:07 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e Sep 30 19:57:07 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:08 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e" returned: 0 in 0.246s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:08 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.info Sep 30 19:57:08 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:08 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.info" returned: 0 in 0.253s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:08 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.info is being set with open permissions: ugo+rw Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:08 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.info Sep 30 19:57:08 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:08 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.info" returned: 0 in 0.252s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1758167960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb20f48-0059-417f-a169-80a9ea5cdca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20c16f891c5468882084c62fa4c43d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:08Z,use_quota=True,user_id='91ec335888d9495bba0f7fa2d169b6c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Creating volume 7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:08 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:57:08 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:08 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 1073741824 Sep 30 19:57:08 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:08 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-52c7f721-141e-4e8d-8682-f912857e7831 tempest-ProjectMemberTests-1043366750 None] Create snapshot completed successfully Sep 30 19:57:09 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 1073741824" returned: 0 in 0.421s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:09 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 Sep 30 19:57:09 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:09 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9" returned: 0 in 0.237s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bf9bf2-00a6-4c55-99d4-644b907cb656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb20f48-0059-417f-a169-80a9ea5cdca9', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03ab961-d80e-4521-b079-2bc9575b9545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:09 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Volume volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 (7eb20f48-0059-417f-a169-80a9ea5cdca9): created successfully Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03ab961-d80e-4521-b079-2bc9575b9545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Flow 'volume_create_manager' (ed29ce76-4965-47d3-a676-dc299b109140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:09 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0740d386-992a-4b5e-b4b8-934c25508f9b tempest-SnapshotDependencyTests-1153768775 None] Created volume successfully. Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-ace8aac0-9cc3-448a-b873-01ac70c5ec1e-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-ace8aac0-9cc3-448a-b873-01ac70c5ec1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-c18578a4-c3e9-4153-a766-d3ca0123a4a0" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-c18578a4-c3e9-4153-a766-d3ca0123a4a0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-ace8aac0-9cc3-448a-b873-01ac70c5ec1e" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-ace8aac0-9cc3-448a-b873-01ac70c5ec1e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Deleting offline snapshot ace8aac0-9cc3-448a-b873-01ac70c5ec1e of volume c18578a4-c3e9-4153-a766-d3ca0123a4a0 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] snapshot_file for this snap is: volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f102bf-dfba-4609-a585-5802caf115ed]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:09 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e Sep 30 19:57:09 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Creating offline snapshot 53a898f0-1a6e-46aa-9d16-e44c2baae47a of volume 7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd33b04-0e0d-4eb7-a20b-556793431726]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:09 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:10 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e" returned: 0 in 0.399s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:57:10 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 Sep 30 19:57:10 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67963bc-8e4d-4114-81b2-5291d58d11ae]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:10 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 Sep 30 19:57:10 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:10 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9" returned: 0 in 0.379s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:10 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a 1G Sep 30 19:57:10 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:10 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0" returned: 0 in 0.363s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:10 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e Sep 30 19:57:10 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:10 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a 1G" returned: 0 in 0.410s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:10 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a Sep 30 19:57:10 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:10 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e" returned: 0 in 0.386s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:10 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:10 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e Sep 30 19:57:10 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:11 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a" returned: 0 in 0.294s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:11 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a is being set with open permissions: ugo+rw Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:11 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a Sep 30 19:57:11 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:11 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0.ace8aac0-9cc3-448a-b873-01ac70c5ec1e" returned: 0 in 0.264s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-ace8aac0-9cc3-448a-b873-01ac70c5ec1e" released by "_delete_snapshot" :: held 1.520s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-c18578a4-c3e9-4153-a766-d3ca0123a4a0" released by "delete_snapshot" :: held 1.546s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Created reservations ['779985c7-e9c8-40af-9a62-1598f9311c0d', '7d42cdaf-86ec-4481-bdc2-952220f4440d', '6773b721-ebb5-4cef-a77a-3a6d22d9f5f8', '90778601-5bde-467b-b00c-defa3077c5b9'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:11 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Delete snapshot completed successfully. Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4b3ba2b8-a0b2-43bc-a100-3a99f0768638 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-ace8aac0-9cc3-448a-b873-01ac70c5ec1e-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:11 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a" returned: 0 in 0.259s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:11 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.info Sep 30 19:57:11 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:11 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.info" returned: 0 in 0.252s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:11 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.info is being set with open permissions: ugo+rw Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:11 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.info Sep 30 19:57:11 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-c18578a4-c3e9-4153-a766-d3ca0123a4a0-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-c18578a4-c3e9-4153-a766-d3ca0123a4a0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-c18578a4-c3e9-4153-a766-d3ca0123a4a0" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-c18578a4-c3e9-4153-a766-d3ca0123a4a0" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9f108c-bb34-4cee-b69f-6cf38f7125af]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:11 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.info" returned: 0 in 0.260s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:11 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:11 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-83ae91da-27ce-4ca5-baf8-be9f5455de77 tempest-SnapshotDependencyTests-1153768775 None] Create snapshot completed successfully Sep 30 19:57:11 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 Sep 30 19:57:11 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:12 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0" returned: 0 in 0.377s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:12 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0 Sep 30 19:57:12 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:12 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-c18578a4-c3e9-4153-a766-d3ca0123a4a0" returned: 0 in 0.273s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-c18578a4-c3e9-4153-a766-d3ca0123a4a0" released by "delete_volume" :: held 0.720s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Created reservations ['57537038-9e47-4ea9-a39e-8bf4e4532089', '84857470-eb15-46d8-8b53-b937302fb661', '2c7cd66a-b439-46c4-b3b8-d803c93c8aca', 'd21d2c2c-ba4b-4af3-b999-2a5f12d421c7'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:12 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:12 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Flow 'volume_create_manager' (99122140-e69b-4129-95c0-0392ef150dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c45880-ac15-410b-a1c8-a5b0d8c9d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c45880-ac15-410b-a1c8-a5b0d8c9d688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315f77f6-73f4-4a6a-8f0d-ddf039aec1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20c16f891c5468882084c62fa4c43d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53a898f0-1a6e-46aa-9d16-e44c2baae47a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:13Z,use_quota=True,user_id='91ec335888d9495bba0f7fa2d169b6c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97355cce-58ee-4478-bb8d-ddec1f071c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97355cce-58ee-4478-bb8d-ddec1f071c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f7a9ac-f755-4481-a8f3-9f529b6b39b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f7a9ac-f755-4481-a8f3-9f529b6b39b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '315f77f6-73f4-4a6a-8f0d-ddf039aec1cc', 'volume_name': 'volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc', 'volume_size': 1, 'snapshot_id': '53a898f0-1a6e-46aa-9d16-e44c2baae47a'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4d3070-c716-4da8-976d-3697ee436013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4d3070-c716-4da8-976d-3697ee436013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c67210-1988-4f8d-a3ad-1f354b250ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:12 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Volume 315f77f6-73f4-4a6a-8f0d-ddf039aec1cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc', 'volume_size': 1, 'snapshot_id': '53a898f0-1a6e-46aa-9d16-e44c2baae47a'} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "cinder-quobyte-53a898f0-1a6e-46aa-9d16-e44c2baae47a-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" by "_create_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-53a898f0-1a6e-46aa-9d16-e44c2baae47a-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Creating volume 315f77f6-73f4-4a6a-8f0d-ddf039aec1cc from snapshot 53a898f0-1a6e-46aa-9d16-e44c2baae47a {{(pid=87426) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "cinder-quobyte-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" by "_copy_volume_from_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] snapshot: 53a898f0-1a6e-46aa-9d16-e44c2baae47a, volume: 315f77f6-73f4-4a6a-8f0d-ddf039aec1cc, {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff746d-fc25-4206-9435-1adb8af816b1]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:12 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.267s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:12 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Deleted volume successfully. Sep 30 19:57:12 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-5a78ffe4-9bf5-4159-99c4-69d2d1497003 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-c18578a4-c3e9-4153-a766-d3ca0123a4a0-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:13 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a Sep 30 19:57:13 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:13 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a" returned: 0 in 0.413s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eb20f48-0059-417f-a169-80a9ea5cdca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[adda2671-b48a-42a5-b837-ae134fe1c831]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:13 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 Sep 30 19:57:13 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (1bbbaab1-8b57-4f19-8fce-b2d70a94bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb510ec-9413-47fa-ab98-531ea47b9b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb510ec-9413-47fa-ab98-531ea47b9b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591695070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efc1a03-b305-4542-b59f-bd594abb0cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:13Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c02875-f116-491d-96c1-15df9e5fcdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c02875-f116-491d-96c1-15df9e5fcdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b019a58b-17ad-4f42-96cd-32153731d380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b019a58b-17ad-4f42-96cd-32153731d380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0efc1a03-b305-4542-b59f-bd594abb0cd9', 'volume_name': 'volume-0efc1a03-b305-4542-b59f-bd594abb0cd9', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59930e4-4286-47f9-8dbd-7e44209cb3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59930e4-4286-47f9-8dbd-7e44209cb3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b663da-888b-4d61-b6b4-d46a409c342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:13 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Volume 0efc1a03-b305-4542-b59f-bd594abb0cd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0efc1a03-b305-4542-b59f-bd594abb0cd9', 'volume_size': 1} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:13 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9" returned: 0 in 0.368s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Creating direct copy from snapshot {{(pid=87426) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG cinder.utils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Path /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc not found in is_blk_device check {{(pid=87426) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 19:57:13 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:13 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc Sep 30 19:57:13 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:19 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" returned: 0 in 6.023s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:19 devstack cinder-volume[87426]: DEBUG cinder.image.image_utils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Image conversion details: src /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc {{(pid=87426) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 19:57:19 devstack cinder-volume[87426]: INFO cinder.image.image_utils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Converted 1024.00 MB image at 169.98 MB/s Sep 30 19:57:19 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc is being set with open permissions: ugo+rw Sep 30 19:57:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:19 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc Sep 30 19:57:19 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:19 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:19 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:19 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" released by "_copy_volume_from_snapshot" :: held 7.149s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=178,cinder:UPDATE=216,cinder:DELETE=19,cinder:INSERT=56 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:57:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=160,cinder:INSERT=58,cinder:UPDATE=219,cinder:DELETE=18 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-53a898f0-1a6e-46aa-9d16-e44c2baae47a-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" released by "_create_volume_from_snapshot" :: held 7.223s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.239s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.521s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591695070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efc1a03-b305-4542-b59f-bd594abb0cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:13Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Creating volume 0efc1a03-b305-4542-b59f-bd594abb0cd9 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:20 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:20 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 1073741824 Sep 30 19:57:20 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c67210-1988-4f8d-a3ad-1f354b250ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc', 'volume_size': 1, 'snapshot_id': '53a898f0-1a6e-46aa-9d16-e44c2baae47a'}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77a9b43-430c-4e46-ab6e-0fb572509436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:20 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Volume volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc (315f77f6-73f4-4a6a-8f0d-ddf039aec1cc): created successfully Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77a9b43-430c-4e46-ab6e-0fb572509436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Flow 'volume_create_manager' (99122140-e69b-4129-95c0-0392ef150dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ddc3ab81-0e9e-4807-bad5-83b620991d8f tempest-SnapshotDependencyTests-1153768775 None] Created volume successfully. Sep 30 19:57:20 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 1073741824" returned: 0 in 0.403s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:20 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 Sep 30 19:57:20 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:20 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b663da-888b-4d61-b6b4-d46a409c342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0efc1a03-b305-4542-b59f-bd594abb0cd9', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18779add-6e0d-4b10-bc0c-b5e141f01e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:20 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Volume volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 (0efc1a03-b305-4542-b59f-bd594abb0cd9): created successfully Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18779add-6e0d-4b10-bc0c-b5e141f01e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:20 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (1bbbaab1-8b57-4f19-8fce-b2d70a94bffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:20 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8c36d905-dbf5-4713-94cb-9318e64154ee tempest-ProjectMemberTests-1043366750 None] Created volume successfully. Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Creating offline snapshot eaa39d9d-c2db-466c-9738-74fdc514e2b2 of volume 0efc1a03-b305-4542-b59f-bd594abb0cd9 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba7d824-fd31-41d5-a073-c240e570a1e1]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:21 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 Sep 30 19:57:21 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "cinder-53a898f0-1a6e-46aa-9d16-e44c2baae47a-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-53a898f0-1a6e-46aa-9d16-e44c2baae47a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "cinder-quobyte-7eb20f48-0059-417f-a169-80a9ea5cdca9" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-7eb20f48-0059-417f-a169-80a9ea5cdca9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "cinder-quobyte-53a898f0-1a6e-46aa-9d16-e44c2baae47a" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-53a898f0-1a6e-46aa-9d16-e44c2baae47a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Deleting offline snapshot 53a898f0-1a6e-46aa-9d16-e44c2baae47a of volume 7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] snapshot_file for this snap is: volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13d293b-3fe8-40a0-9216-9ab264cfb6be]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:21 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9" returned: 0 in 0.375s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:21 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 1G Sep 30 19:57:21 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:21 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a Sep 30 19:57:21 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:21 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a" returned: 0 in 0.380s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eb20f48-0059-417f-a169-80a9ea5cdca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886b35c-69a3-4a5f-a9c6-c044fbb1b1b9]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:21 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 1G" returned: 0 in 0.413s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:21 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:21 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 Sep 30 19:57:21 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:21 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 Sep 30 19:57:21 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:22 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2" returned: 0 in 0.292s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:22 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 is being set with open permissions: ugo+rw Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:22 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 Sep 30 19:57:22 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:22 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9" returned: 0 in 0.599s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:22 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2" returned: 0 in 0.259s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:22 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a Sep 30 19:57:22 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:22 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.info Sep 30 19:57:22 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:22 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.info" returned: 0 in 0.259s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:22 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.info is being set with open permissions: ugo+rw Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:22 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.info Sep 30 19:57:22 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:22 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a" returned: 0 in 0.349s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:22 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a Sep 30 19:57:22 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:22 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.info" returned: 0 in 0.249s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:22 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-c1dc4504-f606-449c-b9e9-28ecbd4c2c69 tempest-ProjectMemberTests-1043366750 None] Create snapshot completed successfully Sep 30 19:57:22 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:22 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9.53a898f0-1a6e-46aa-9d16-e44c2baae47a" returned: 0 in 0.256s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-53a898f0-1a6e-46aa-9d16-e44c2baae47a" released by "_delete_snapshot" :: held 1.695s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-7eb20f48-0059-417f-a169-80a9ea5cdca9" released by "delete_snapshot" :: held 1.716s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Created reservations ['4ce0ff7b-1e81-4cef-86f7-f933a13a701d', '5aa1368f-0c85-4cb9-a561-d18ab221119a', 'a97d45ec-5a13-4c05-891c-c06c54ae6df7', 'c2bc135a-0447-4a6f-a33e-c8ec7f69330c'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-eaa39d9d-c2db-466c-9738-74fdc514e2b2-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:23 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Delete snapshot completed successfully. Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-eaa39d9d-c2db-466c-9738-74fdc514e2b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-0efc1a03-b305-4542-b59f-bd594abb0cd9" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-6012e1de-5efc-491c-b842-e1b1d8a3482d tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-53a898f0-1a6e-46aa-9d16-e44c2baae47a-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-0efc1a03-b305-4542-b59f-bd594abb0cd9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-eaa39d9d-c2db-466c-9738-74fdc514e2b2" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-eaa39d9d-c2db-466c-9738-74fdc514e2b2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Deleting offline snapshot eaa39d9d-c2db-466c-9738-74fdc514e2b2 of volume 0efc1a03-b305-4542-b59f-bd594abb0cd9 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] snapshot_file for this snap is: volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cec054-d629-4b29-a9ff-28146f6f4e33]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:23 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 Sep 30 19:57:23 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "cinder-7eb20f48-0059-417f-a169-80a9ea5cdca9-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-7eb20f48-0059-417f-a169-80a9ea5cdca9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "cinder-quobyte-7eb20f48-0059-417f-a169-80a9ea5cdca9" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-7eb20f48-0059-417f-a169-80a9ea5cdca9" acquired by "delete_volume" :: waited 0.024s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8477723-0b0c-48ba-85a9-6934620569bf]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:23 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2" returned: 0 in 0.378s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0efc1a03-b305-4542-b59f-bd594abb0cd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[df68b664-e14b-4392-933b-bdc11305d4b1]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:23 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 Sep 30 19:57:23 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:23 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 Sep 30 19:57:23 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:23 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9" returned: 0 in 0.366s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:23 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9 Sep 30 19:57:23 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:23 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:23 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:24 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9" returned: 0 in 0.386s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:24 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 Sep 30 19:57:24 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:24 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-7eb20f48-0059-417f-a169-80a9ea5cdca9" returned: 0 in 0.266s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:24 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.270s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-7eb20f48-0059-417f-a169-80a9ea5cdca9" released by "delete_volume" :: held 0.711s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Created reservations ['a7433615-126c-4cdb-8da8-c92b5e135556', 'c24c78d7-ea27-43ea-900f-a773000bb656', '7a8b964c-4fcf-4dfe-8b9b-8c18631afff8', '833730b4-9406-4c09-965b-ff8cb6525c14'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:24 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:24 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:24 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2" returned: 0 in 0.361s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:24 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2 Sep 30 19:57:24 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "cinder-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:24 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.262s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:24 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Deleted volume successfully. Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "cinder-quobyte-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:24 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-92e9ef4a-b327-4815-8349-812a0a6b67c7 tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-7eb20f48-0059-417f-a169-80a9ea5cdca9-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9.eaa39d9d-c2db-466c-9738-74fdc514e2b2" returned: 0 in 0.280s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-eaa39d9d-c2db-466c-9738-74fdc514e2b2" released by "_delete_snapshot" :: held 1.513s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" acquired by "delete_volume" :: waited 0.041s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-0efc1a03-b305-4542-b59f-bd594abb0cd9" released by "delete_snapshot" :: held 1.545s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9412d816-317a-40d4-bf6d-d859828f4f29]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Created reservations ['a49a03c6-9d5b-4a71-85ea-9f0dbed7ebf4', 'c0873c3f-e66d-4cc8-a8d4-b7401caf8f9c', '7bcc9cde-f213-4554-93b5-b8e3489135c3', 'fc3bddd7-acf7-4d2a-9ebd-3837be619cf9'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:24 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Delete snapshot completed successfully. Sep 30 19:57:24 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-cffc8787-7987-4f4c-9eb1-deb03f7957f7 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-eaa39d9d-c2db-466c-9738-74fdc514e2b2-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:24 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc Sep 30 19:57:24 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:25 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" returned: 0 in 0.357s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:25 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc Sep 30 19:57:25 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-0efc1a03-b305-4542-b59f-bd594abb0cd9-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-0efc1a03-b305-4542-b59f-bd594abb0cd9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:25 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" returned: 0 in 0.258s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-quobyte-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc" released by "delete_volume" :: held 0.662s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-0efc1a03-b305-4542-b59f-bd594abb0cd9" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-0efc1a03-b305-4542-b59f-bd594abb0cd9" acquired by "delete_volume" :: waited 0.023s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f5fa0b-603f-416b-ad81-a95bd4086857]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Created reservations ['a2f46a7f-2384-4b56-a215-cffe13e056b7', '32c83ed5-3319-4848-919b-162acd830d15', 'eb6b37a5-3be9-4910-a33d-69a02a38c5c2', 'fd622c60-089f-4c5a-8e71-900cd40fbd75'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:25 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 Sep 30 19:57:25 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:25 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:25 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:25 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.256s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:25 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Deleted volume successfully. Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-ab17100d-8f01-43e6-af88-d8791bd35e39 tempest-SnapshotDependencyTests-1153768775 None] Lock "cinder-315f77f6-73f4-4a6a-8f0d-ddf039aec1cc-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:25 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9" returned: 0 in 0.400s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:25 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:25 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9 Sep 30 19:57:25 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:26 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0efc1a03-b305-4542-b59f-bd594abb0cd9" returned: 0 in 0.249s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-0efc1a03-b305-4542-b59f-bd594abb0cd9" released by "delete_volume" :: held 0.715s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Created reservations ['f780efdb-4a2e-40eb-8b99-bb9ce851191d', 'a8ed41ca-72b3-4292-ac15-e096fe27896d', '174eba8e-56d1-453c-a499-94a3c2be0913', 'e3e53a4c-6b44-47ab-86a9-3f9c6a0dc6fa'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:26 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:26 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:26 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.265s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:26 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Deleted volume successfully. Sep 30 19:57:26 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-b017d836-f5b8-4aed-aba1-9981fd8d2831 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-0efc1a03-b305-4542-b59f-bd594abb0cd9-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (39b5f981-e578-44d4-8938-fbfa0e7a69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f3c1e6-e35a-4b3d-82ff-e3ed5a11352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f3c1e6-e35a-4b3d-82ff-e3ed5a11352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268479783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f0d15e-9d91-49f3-96e0-ce12df7057cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:27Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44641fd0-b3fd-40fa-a264-b1bedaad7c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44641fd0-b3fd-40fa-a264-b1bedaad7c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1bdecb-f58c-4f28-837f-cc8bfae97319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1bdecb-f58c-4f28-837f-cc8bfae97319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f0d15e-9d91-49f3-96e0-ce12df7057cc', 'volume_name': 'volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43268d5-ae29-4628-a84d-d734f595ce0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43268d5-ae29-4628-a84d-d734f595ce0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d2e307-05d8-4017-b4db-f95d004ff1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Volume 81f0d15e-9d91-49f3-96e0-ce12df7057cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc', 'volume_size': 1} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268479783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f0d15e-9d91-49f3-96e0-ce12df7057cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:27Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Creating volume 81f0d15e-9d91-49f3-96e0-ce12df7057cc {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:27 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:27 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc 1073741824 Sep 30 19:57:27 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:27 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc 1073741824" returned: 0 in 0.461s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:27 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc Sep 30 19:57:27 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:27 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc" returned: 0 in 0.262s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d2e307-05d8-4017-b4db-f95d004ff1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e32680-30cd-44e6-9381-ac6a19aca2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:27 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Volume volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc (81f0d15e-9d91-49f3-96e0-ce12df7057cc): created successfully Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e32680-30cd-44e6-9381-ac6a19aca2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:27 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (39b5f981-e578-44d4-8938-fbfa0e7a69fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:27 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-52e6a687-10ae-4a1b-a24a-7cb7b676c8a5 tempest-ProjectMemberTests-1043366750 None] Created volume successfully. Sep 30 19:57:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:29 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Creating offline snapshot 84633d99-5ae1-46f8-8907-5b69bd067650 of volume 81f0d15e-9d91-49f3-96e0-ce12df7057cc {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:57:29 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aff025-3475-47d7-a60b-45d9b78b4e7f]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:29 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc Sep 30 19:57:29 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:29 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc" returned: 0 in 0.353s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:29 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:29 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 1G Sep 30 19:57:29 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:30 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 1G" returned: 0 in 0.488s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:30 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 Sep 30 19:57:30 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:30 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650" returned: 0 in 0.304s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:30 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 is being set with open permissions: ugo+rw Sep 30 19:57:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:30 devstack sudo[109274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 Sep 30 19:57:30 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:30 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650" returned: 0 in 0.259s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:30 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.info Sep 30 19:57:30 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:30 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.info" returned: 0 in 0.272s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:30 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.info is being set with open permissions: ugo+rw Sep 30 19:57:30 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:30 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.info Sep 30 19:57:30 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:31 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.info" returned: 0 in 0.257s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:31 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:31 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-322482e3-2d0e-423c-882d-87ab48b615df tempest-ProjectMemberTests-1043366750 None] Create snapshot completed successfully Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-84633d99-5ae1-46f8-8907-5b69bd067650-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-84633d99-5ae1-46f8-8907-5b69bd067650-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-81f0d15e-9d91-49f3-96e0-ce12df7057cc" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-81f0d15e-9d91-49f3-96e0-ce12df7057cc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-84633d99-5ae1-46f8-8907-5b69bd067650" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-84633d99-5ae1-46f8-8907-5b69bd067650" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Deleting offline snapshot 84633d99-5ae1-46f8-8907-5b69bd067650 of volume 81f0d15e-9d91-49f3-96e0-ce12df7057cc {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] snapshot_file for this snap is: volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe8678f-a264-483e-9ff5-e59ceab264f8]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:32 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 Sep 30 19:57:32 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:32 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650" returned: 0 in 0.378s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[22386d4f-3e1b-478c-a756-b5cbb633ac5b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:32 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:33 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc Sep 30 19:57:33 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:33 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc" returned: 0 in 0.384s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:33 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 Sep 30 19:57:33 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:33 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650" returned: 0 in 0.326s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:33 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650 Sep 30 19:57:33 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:33 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:33 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc.84633d99-5ae1-46f8-8907-5b69bd067650" returned: 0 in 0.252s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-84633d99-5ae1-46f8-8907-5b69bd067650" released by "_delete_snapshot" :: held 1.455s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:33 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-81f0d15e-9d91-49f3-96e0-ce12df7057cc" released by "delete_snapshot" :: held 1.485s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:34 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Created reservations ['a0154cd2-623b-4344-968a-3ab85d2033ac', 'bd477658-8aac-4ea4-8783-6af1706f4f9c', 'd795a1e0-bc8d-4219-b68e-7f4261c0b502', 'd9a3bc53-132d-4bb8-8531-31799529e541'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:34 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Delete snapshot completed successfully. Sep 30 19:57:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-58886a87-b9cc-4dda-9fa1-2bf175b4dd64 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-84633d99-5ae1-46f8-8907-5b69bd067650-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-81f0d15e-9d91-49f3-96e0-ce12df7057cc-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-81f0d15e-9d91-49f3-96e0-ce12df7057cc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-81f0d15e-9d91-49f3-96e0-ce12df7057cc" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:34 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-81f0d15e-9d91-49f3-96e0-ce12df7057cc" acquired by "delete_volume" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:34 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9935860a-2d8e-4a6b-bafe-3ffc05e077bd]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:34 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:34 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc Sep 30 19:57:34 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:35 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc" returned: 0 in 0.417s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:35 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc Sep 30 19:57:35 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:35 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-81f0d15e-9d91-49f3-96e0-ce12df7057cc" returned: 0 in 0.256s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-81f0d15e-9d91-49f3-96e0-ce12df7057cc" released by "delete_volume" :: held 0.745s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Created reservations ['397c7934-c0cc-405a-b7b7-d4a61c0d811b', '3119984e-fb45-49c8-8372-1e95d35e9892', '241cd5b0-a95b-478f-8ea0-b1237b34bc51', '89342480-644e-4a5d-9c09-919a4acb8c97'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:35 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:35 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:35 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.268s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:35 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Deleted volume successfully. Sep 30 19:57:35 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-440f3729-c27a-4c7d-b95f-e9c5f73ea0d3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-81f0d15e-9d91-49f3-96e0-ce12df7057cc-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (ecc6f0be-972d-49b6-872d-97df0ce5c326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9d6bd2-bc9f-4ad7-9f62-13ceebe19cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9d6bd2-bc9f-4ad7-9f62-13ceebe19cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1125670363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab25776c-0d3a-4247-ae89-25ec025b5113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:36Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084c9b3d-a76c-4724-b427-2d5851fe5465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084c9b3d-a76c-4724-b427-2d5851fe5465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dbd64e-a9e0-41c8-825c-d59ce8c3c7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dbd64e-a9e0-41c8-825c-d59ce8c3c7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab25776c-0d3a-4247-ae89-25ec025b5113', 'volume_name': 'volume-ab25776c-0d3a-4247-ae89-25ec025b5113', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b3a4fa-3be6-4070-b3cb-56be26425715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b3a4fa-3be6-4070-b3cb-56be26425715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfff604e-2662-45f8-8bb2-08dd4917e7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:36 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Volume ab25776c-0d3a-4247-ae89-25ec025b5113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab25776c-0d3a-4247-ae89-25ec025b5113', 'volume_size': 1} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1125670363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab25776c-0d3a-4247-ae89-25ec025b5113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:36Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Creating volume ab25776c-0d3a-4247-ae89-25ec025b5113 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:36 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:36 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 1073741824 Sep 30 19:57:36 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:36 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 1073741824" returned: 0 in 0.422s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:36 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:36 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 Sep 30 19:57:36 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:37 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfff604e-2662-45f8-8bb2-08dd4917e7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab25776c-0d3a-4247-ae89-25ec025b5113', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6686f0d-abeb-4419-92e7-b6162074e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:37 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Volume volume-ab25776c-0d3a-4247-ae89-25ec025b5113 (ab25776c-0d3a-4247-ae89-25ec025b5113): created successfully Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6686f0d-abeb-4419-92e7-b6162074e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (ecc6f0be-972d-49b6-872d-97df0ce5c326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:37 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-987c8a90-152a-41f8-9294-2f9acbff4205 tempest-ProjectMemberTests-1043366750 None] Created volume successfully. Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Creating offline snapshot 63bb754b-b462-48d1-a241-f434837e0ce7 of volume ab25776c-0d3a-4247-ae89-25ec025b5113 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[823b762c-4aa9-4903-a2e6-4b3005f93706]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:37 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 Sep 30 19:57:37 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:37 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113" returned: 0 in 0.354s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:37 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:37 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 1G Sep 30 19:57:37 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:38 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 1G" returned: 0 in 0.383s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab25776c-0d3a-4247-ae89-25ec025b5113 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:38 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab25776c-0d3a-4247-ae89-25ec025b5113 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 Sep 30 19:57:38 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:38 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab25776c-0d3a-4247-ae89-25ec025b5113 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7" returned: 0 in 0.283s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:38 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 is being set with open permissions: ugo+rw Sep 30 19:57:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:38 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 Sep 30 19:57:38 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:38 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7" returned: 0 in 0.242s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:38 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.info Sep 30 19:57:38 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:38 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.info" returned: 0 in 0.245s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:38 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.info is being set with open permissions: ugo+rw Sep 30 19:57:38 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:38 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.info Sep 30 19:57:38 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:39 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.info" returned: 0 in 0.238s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:39 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-46ff1669-5f85-4da8-9012-19f95b1dafd3 tempest-ProjectMemberTests-1043366750 None] Create snapshot completed successfully Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-63bb754b-b462-48d1-a241-f434837e0ce7-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-63bb754b-b462-48d1-a241-f434837e0ce7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-ab25776c-0d3a-4247-ae89-25ec025b5113" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-ab25776c-0d3a-4247-ae89-25ec025b5113" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-63bb754b-b462-48d1-a241-f434837e0ce7" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-63bb754b-b462-48d1-a241-f434837e0ce7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Deleting offline snapshot 63bb754b-b462-48d1-a241-f434837e0ce7 of volume ab25776c-0d3a-4247-ae89-25ec025b5113 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] snapshot_file for this snap is: volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4fd42a-8f68-48e4-bf1c-5b84c8b134ef]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:39 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 Sep 30 19:57:39 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:39 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7" returned: 0 in 0.358s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:39 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab25776c-0d3a-4247-ae89-25ec025b5113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:57:40 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d142481f-554b-4a3f-a2ee-e3f66a50914a]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:40 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 Sep 30 19:57:40 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:40 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113" returned: 0 in 0.344s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:40 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 Sep 30 19:57:40 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:40 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7" returned: 0 in 0.334s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:40 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7 Sep 30 19:57:40 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:40 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:40 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113.63bb754b-b462-48d1-a241-f434837e0ce7" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-63bb754b-b462-48d1-a241-f434837e0ce7" released by "_delete_snapshot" :: held 1.376s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:40 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-ab25776c-0d3a-4247-ae89-25ec025b5113" released by "delete_snapshot" :: held 1.399s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:41 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Created reservations ['862ab158-fee7-421b-89bd-89c0b6e40a75', '8380104e-5973-4e0b-9614-40193d207790', '3c2c3897-f97d-41d8-99e6-1d64cfd163be', '3ef42e72-a34f-4a4b-ac9d-1b06e31595b7'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:41 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Delete snapshot completed successfully. Sep 30 19:57:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-9b99b7f9-4780-45bc-bc1f-6d51c0a164a5 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-63bb754b-b462-48d1-a241-f434837e0ce7-delete_snapshot" released by "delete_snapshot" :: held 1.541s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-ab25776c-0d3a-4247-ae89-25ec025b5113-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-ab25776c-0d3a-4247-ae89-25ec025b5113-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-ab25776c-0d3a-4247-ae89-25ec025b5113" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:41 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-ab25776c-0d3a-4247-ae89-25ec025b5113" acquired by "delete_volume" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:41 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0796d6e2-eeea-43b4-9d86-ae804d6dda77]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:41 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:41 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 Sep 30 19:57:41 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:42 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113" returned: 0 in 0.354s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:42 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113 Sep 30 19:57:42 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:42 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-ab25776c-0d3a-4247-ae89-25ec025b5113" returned: 0 in 0.244s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-ab25776c-0d3a-4247-ae89-25ec025b5113" released by "delete_volume" :: held 0.657s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Created reservations ['d5286683-a329-4401-a464-97991af73611', '4a983141-8e51-4dff-958f-ec3443697186', '7ac6e026-86dc-4cd3-b137-e8d43d84ef2d', '06afff3e-bef2-47cb-bc88-fbae09932700'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:42 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:42 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:42 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.251s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:42 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Deleted volume successfully. Sep 30 19:57:42 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-4740abac-fa0d-4f23-b1fb-d2c671344434 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-ab25776c-0d3a-4247-ae89-25ec025b5113-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (5c6a0409-f0c9-4b54-ad67-ad2307360bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be71520f-ec05-4900-b179-6b50a6d80b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be71520f-ec05-4900-b179-6b50a6d80b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537547970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3b68fb-c201-455e-ad49-646a48c0f046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:43Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7927f6c-dce9-4e9d-afd4-9ad2571a1399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7927f6c-dce9-4e9d-afd4-9ad2571a1399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c3a25d-a326-4f5f-ac34-99a98894903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c3a25d-a326-4f5f-ac34-99a98894903f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3b68fb-c201-455e-ad49-646a48c0f046', 'volume_name': 'volume-be3b68fb-c201-455e-ad49-646a48c0f046', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c55a3a5-696d-41a1-8621-62b1272535db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c55a3a5-696d-41a1-8621-62b1272535db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f116450c-2d57-408b-9f48-9227d1869106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:43 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Volume be3b68fb-c201-455e-ad49-646a48c0f046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3b68fb-c201-455e-ad49-646a48c0f046', 'volume_size': 1} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537547970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3b68fb-c201-455e-ad49-646a48c0f046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:43Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Creating volume be3b68fb-c201-455e-ad49-646a48c0f046 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:43 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:43 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 1073741824 Sep 30 19:57:43 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:43 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 1073741824" returned: 0 in 0.403s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:43 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:43 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 Sep 30 19:57:43 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:44 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046" returned: 0 in 0.246s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f116450c-2d57-408b-9f48-9227d1869106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3b68fb-c201-455e-ad49-646a48c0f046', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a342336-0ac5-4f2d-8bc6-2a6e6f557dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:44 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Volume volume-be3b68fb-c201-455e-ad49-646a48c0f046 (be3b68fb-c201-455e-ad49-646a48c0f046): created successfully Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a342336-0ac5-4f2d-8bc6-2a6e6f557dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (5c6a0409-f0c9-4b54-ad67-ad2307360bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:44 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-1a01c5cd-e723-420c-9a0f-da78f80be07f tempest-ProjectMemberTests-1043366750 None] Created volume successfully. Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Creating offline snapshot d31d6023-6cab-4050-b841-98ce1fb02fc6 of volume be3b68fb-c201-455e-ad49-646a48c0f046 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[07214b1e-b629-424e-ad11-d817f5b84eca]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:44 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 Sep 30 19:57:44 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:44 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046" returned: 0 in 0.372s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:44 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:44 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 1G Sep 30 19:57:44 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:45 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 1G" returned: 0 in 0.383s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3b68fb-c201-455e-ad49-646a48c0f046 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:45 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3b68fb-c201-455e-ad49-646a48c0f046 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 Sep 30 19:57:45 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:45 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3b68fb-c201-455e-ad49-646a48c0f046 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6" returned: 0 in 0.286s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:45 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 is being set with open permissions: ugo+rw Sep 30 19:57:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:45 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 Sep 30 19:57:45 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:45 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:45 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:45 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.info Sep 30 19:57:45 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:46 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.info" returned: 0 in 0.263s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:46 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.info is being set with open permissions: ugo+rw Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:46 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.info Sep 30 19:57:46 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:46 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.info" returned: 0 in 0.251s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:46 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-8b2a339c-e4d3-4b20-a6be-3f7f261774de tempest-ProjectMemberTests-1043366750 None] Create snapshot completed successfully Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-d31d6023-6cab-4050-b841-98ce1fb02fc6-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Lock "cinder-d31d6023-6cab-4050-b841-98ce1fb02fc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-be3b68fb-c201-455e-ad49-646a48c0f046" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-be3b68fb-c201-455e-ad49-646a48c0f046" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-d31d6023-6cab-4050-b841-98ce1fb02fc6" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-d31d6023-6cab-4050-b841-98ce1fb02fc6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Deleting offline snapshot d31d6023-6cab-4050-b841-98ce1fb02fc6 of volume be3b68fb-c201-455e-ad49-646a48c0f046 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] snapshot_file for this snap is: volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eabeff8-4330-4d11-9ab8-a30fee249387]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:46 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 Sep 30 19:57:46 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:46 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6" returned: 0 in 0.353s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be3b68fb-c201-455e-ad49-646a48c0f046(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aca856c-2038-49f7-a478-819065cd3e89]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:46 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:47 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 Sep 30 19:57:47 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:47 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046" returned: 0 in 0.361s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:47 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 Sep 30 19:57:47 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:47 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6" returned: 0 in 0.323s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:47 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6 Sep 30 19:57:47 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:47 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:47 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046.d31d6023-6cab-4050-b841-98ce1fb02fc6" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-d31d6023-6cab-4050-b841-98ce1fb02fc6" released by "_delete_snapshot" :: held 1.373s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:47 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-be3b68fb-c201-455e-ad49-646a48c0f046" released by "delete_snapshot" :: held 1.393s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:48 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Created reservations ['fa28a158-9c87-4a87-b595-5bdb9a0c8538', 'de7d0f40-6a09-4ffa-972f-45c60503c303', '7b771114-4b32-4149-bbf5-77f20c320f14', '192c4573-262b-45f2-aaf6-3f1025f5df9f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:48 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Delete snapshot completed successfully. Sep 30 19:57:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-01fe4129-b9b4-4acf-afe3-8873b34e32cb tempest-ProjectMemberTests-1043366750 None] Lock "cinder-d31d6023-6cab-4050-b841-98ce1fb02fc6-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-be3b68fb-c201-455e-ad49-646a48c0f046-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-be3b68fb-c201-455e-ad49-646a48c0f046-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-be3b68fb-c201-455e-ad49-646a48c0f046" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:48 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-be3b68fb-c201-455e-ad49-646a48c0f046" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:48 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b063e6-df12-4e38-a1ff-d5bebf83707b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:48 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:48 devstack sudo[109433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 Sep 30 19:57:48 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:49 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046" returned: 0 in 0.351s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:49 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046 Sep 30 19:57:49 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:49 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-be3b68fb-c201-455e-ad49-646a48c0f046" returned: 0 in 0.242s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-be3b68fb-c201-455e-ad49-646a48c0f046" released by "delete_volume" :: held 0.652s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Created reservations ['c93fa683-f11e-40a5-8ff9-e871967880fd', 'e81bf01b-0512-44ae-9787-b7895a0dda92', 'b4fcadf4-72fc-47b7-b420-ed2c5fedd343', '86ae1011-d54f-47ce-9714-6ef649b7c5bc'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:49 devstack sudo[109441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:49 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:49 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.251s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:49 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Deleted volume successfully. Sep 30 19:57:49 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-26f85030-61ec-4757-987a-daa20bf1eebd tempest-ProjectMemberTests-1043366750 None] Lock "cinder-be3b68fb-c201-455e-ad49-646a48c0f046-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (6633d66f-d2ca-4512-a341-22eed4a539e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e856d7-ece0-415b-bc1a-16109e2f5ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e856d7-ece0-415b-bc1a-16109e2f5ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102742928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d10c833-7102-415a-b81f-67bbe3c72ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:50Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0380a96b-0114-49b6-825e-097d5b123ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0380a96b-0114-49b6-825e-097d5b123ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681bc578-7ceb-4d31-8805-8562a058cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681bc578-7ceb-4d31-8805-8562a058cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d10c833-7102-415a-b81f-67bbe3c72ef1', 'volume_name': 'volume-0d10c833-7102-415a-b81f-67bbe3c72ef1', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb757a0-33cd-4853-b99e-2fe33c11020c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb757a0-33cd-4853-b99e-2fe33c11020c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f189680-d0a5-4e45-9acb-fd5c06492b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:50 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Volume 0d10c833-7102-415a-b81f-67bbe3c72ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d10c833-7102-415a-b81f-67bbe3c72ef1', 'volume_size': 1} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102742928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d10c833-7102-415a-b81f-67bbe3c72ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:50Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Creating volume 0d10c833-7102-415a-b81f-67bbe3c72ef1 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:50 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:50 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 1073741824 Sep 30 19:57:50 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:50 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 1073741824" returned: 0 in 0.407s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:50 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:50 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 Sep 30 19:57:50 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:51 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1" returned: 0 in 0.250s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f189680-d0a5-4e45-9acb-fd5c06492b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d10c833-7102-415a-b81f-67bbe3c72ef1', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f3da66-d6b1-4e03-9a2d-7b2c308ee435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:51 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Volume volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 (0d10c833-7102-415a-b81f-67bbe3c72ef1): created successfully Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f3da66-d6b1-4e03-9a2d-7b2c308ee435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (6633d66f-d2ca-4512-a341-22eed4a539e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:51 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-624c2397-6211-49fc-9f0b-356742b4afd0 tempest-ProjectMemberTests-1043366750 None] Created volume successfully. Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Creating offline snapshot ad563ab4-9372-45d4-a3dc-65f07905fe20 of volume 0d10c833-7102-415a-b81f-67bbe3c72ef1 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd23b05-05d9-416b-b98b-b2e57f557ffb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:51 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 Sep 30 19:57:51 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:51 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1" returned: 0 in 0.364s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:51 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:51 devstack sudo[109459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 1G Sep 30 19:57:51 devstack sudo[109459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:52 devstack sudo[109459]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 1G" returned: 0 in 0.387s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:52 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 Sep 30 19:57:52 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:52 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20" returned: 0 in 0.293s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:52 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 is being set with open permissions: ugo+rw Sep 30 19:57:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:52 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 Sep 30 19:57:52 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:52 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:52 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:52 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.info Sep 30 19:57:52 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:53 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.info" returned: 0 in 0.254s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:53 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.info is being set with open permissions: ugo+rw Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:53 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.info Sep 30 19:57:53 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:53 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.info" returned: 0 in 0.243s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:53 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-14c5b025-a130-44d6-b40d-80a0587a5480 tempest-ProjectMemberTests-1043366750 None] Create snapshot completed successfully Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-ad563ab4-9372-45d4-a3dc-65f07905fe20-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-ad563ab4-9372-45d4-a3dc-65f07905fe20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-0d10c833-7102-415a-b81f-67bbe3c72ef1" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-0d10c833-7102-415a-b81f-67bbe3c72ef1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-ad563ab4-9372-45d4-a3dc-65f07905fe20" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-ad563ab4-9372-45d4-a3dc-65f07905fe20" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Deleting offline snapshot ad563ab4-9372-45d4-a3dc-65f07905fe20 of volume 0d10c833-7102-415a-b81f-67bbe3c72ef1 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] snapshot_file for this snap is: volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d271d4a1-cce4-46ce-8fc7-9a6f0fdb7a2c]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:53 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 Sep 30 19:57:53 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:53 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20" returned: 0 in 0.355s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:53 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d10c833-7102-415a-b81f-67bbe3c72ef1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:57:54 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9968a6-1190-4c96-8609-c4f6f8be2d4b]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:54 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 Sep 30 19:57:54 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:54 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1" returned: 0 in 0.348s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:54 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 Sep 30 19:57:54 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:54 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20" returned: 0 in 0.329s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:54 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20 Sep 30 19:57:54 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:54 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:54 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1.ad563ab4-9372-45d4-a3dc-65f07905fe20" returned: 0 in 0.240s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-ad563ab4-9372-45d4-a3dc-65f07905fe20" released by "_delete_snapshot" :: held 1.366s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:54 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-0d10c833-7102-415a-b81f-67bbe3c72ef1" released by "delete_snapshot" :: held 1.387s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:55 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Created reservations ['48c022ef-a284-4a5c-8dd7-fb685904b637', 'd344881c-bbf9-44f6-a26b-ee57b6db2ee3', 'e499723a-0d18-46a7-ab1a-eb7ac8e77aa7', '7e59f2fd-853c-4f2a-b220-4e0eebe41e7d'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:55 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Delete snapshot completed successfully. Sep 30 19:57:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-f02bc952-8d24-49e1-9e18-7abe25467555 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-ad563ab4-9372-45d4-a3dc-65f07905fe20-delete_snapshot" released by "delete_snapshot" :: held 1.524s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-0d10c833-7102-415a-b81f-67bbe3c72ef1-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-0d10c833-7102-415a-b81f-67bbe3c72ef1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-0d10c833-7102-415a-b81f-67bbe3c72ef1" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:57:55 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-0d10c833-7102-415a-b81f-67bbe3c72ef1" acquired by "delete_volume" :: waited 0.015s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:57:55 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[76319118-31a1-40e9-a147-2d6d14b55315]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:55 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:55 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 Sep 30 19:57:55 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:56 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1" returned: 0 in 0.347s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:56 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1 Sep 30 19:57:56 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:56 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-0d10c833-7102-415a-b81f-67bbe3c72ef1" returned: 0 in 0.248s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-0d10c833-7102-415a-b81f-67bbe3c72ef1" released by "delete_volume" :: held 0.655s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Created reservations ['af923aba-3c1d-48d2-a75e-65cbc273d3fc', 'c2f5a225-f3a8-44e1-ba83-9ec3f63164b9', 'fca2b731-4dd0-48c3-9f13-d98a41f78a25', '58b5402e-7eb3-497d-8658-2920aae029ad'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:56 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:57:56 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:56 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.242s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:57:56 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Deleted volume successfully. Sep 30 19:57:56 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a3e8238b-a2f4-4478-9583-a6d3cc3351b9 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-0d10c833-7102-415a-b81f-67bbe3c72ef1-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.flows.manager.create_volume [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87426) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (9d19027f-f98f-4441-87a0-9a2bed4f07a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03655ba2-6ca0-4a55-b1a6-b704e8a5957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03655ba2-6ca0-4a55-b1a6-b704e8a5957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361699934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4037a29c-5a53-4f62-b9c8-8d3930008869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:57Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a604220c-65b8-42b9-8c84-0afea0b6132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a604220c-65b8-42b9-8c84-0afea0b6132b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba47bc3-d865-4b04-866a-dea5a9f0c864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba47bc3-d865-4b04-866a-dea5a9f0c864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4037a29c-5a53-4f62-b9c8-8d3930008869', 'volume_name': 'volume-4037a29c-5a53-4f62-b9c8-8d3930008869', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473459fd-45ef-4cca-9b93-1d0f35451c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473459fd-45ef-4cca-9b93-1d0f35451c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8c7240-9161-4d28-8f3f-c86811ffb9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:57 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Volume 4037a29c-5a53-4f62-b9c8-8d3930008869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4037a29c-5a53-4f62-b9c8-8d3930008869', 'volume_size': 1} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T17:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361699934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4037a29c-5a53-4f62-b9c8-8d3930008869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f070ce83f9fe4e22bd16bf445f57a8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T17:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T17:57:57Z,use_quota=True,user_id='ece6bc5d9849494fbc043e14f99d355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1befdf12-ee40-44a8-9d22-9ff867c6e13a),volume_type_id=1befdf12-ee40-44a8-9d22-9ff867c6e13a)}" {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Creating volume 4037a29c-5a53-4f62-b9c8-8d3930008869 {{(pid=87426) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Selected osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 as target Quobyte volume. {{(pid=87426) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 19:57:57 devstack cinder-volume[87426]: INFO cinder.volume.drivers.remotefs [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] casted to osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217 Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 1073741824 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:57 devstack sudo[109508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 1073741824 Sep 30 19:57:57 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:57 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 1073741824" returned: 0 in 0.405s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:57 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:57 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 Sep 30 19:57:57 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:58 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869" returned: 0 in 0.242s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'} {{(pid=87426) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8c7240-9161-4d28-8f3f-c86811ffb9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4037a29c-5a53-4f62-b9c8-8d3930008869', 'volume_size': 1}' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7609606-d9eb-4ed2-857b-67ef7c093559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 19:57:58 devstack cinder-volume[87426]: INFO cinder.volume.flows.manager.create_volume [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Volume volume-4037a29c-5a53-4f62-b9c8-8d3930008869 (4037a29c-5a53-4f62-b9c8-8d3930008869): created successfully Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7609606-d9eb-4ed2-857b-67ef7c093559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87426) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Flow 'volume_create_manager' (9d19027f-f98f-4441-87a0-9a2bed4f07a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87426) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 19:57:58 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a588ce8a-354f-4bc9-a2f2-72722a5ee064 tempest-ProjectMemberTests-1043366750 None] Created volume successfully. Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Creating offline snapshot 3fc09d7c-1e86-43ab-ad59-f4779e48595d of volume 4037a29c-5a53-4f62-b9c8-8d3930008869 {{(pid=87426) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dd24a3-721b-4ec4-9e57-908f626d19cd]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:58 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 Sep 30 19:57:58 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:58 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869" returned: 0 in 0.356s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:58 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d 1G {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:58 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d 1G Sep 30 19:57:58 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:59 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d 1G" returned: 0 in 0.411s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4037a29c-5a53-4f62-b9c8-8d3930008869 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:59 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4037a29c-5a53-4f62-b9c8-8d3930008869 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d Sep 30 19:57:59 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:59 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4037a29c-5a53-4f62-b9c8-8d3930008869 -F qcow2 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d" returned: 0 in 0.281s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:59 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d is being set with open permissions: ugo+rw Sep 30 19:57:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:59 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d Sep 30 19:57:59 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:59 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d" returned: 0 in 0.240s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:57:59 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.info Sep 30 19:57:59 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:57:59 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 30 19:57:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.info" returned: 0 in 0.244s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:57:59 devstack cinder-volume[87426]: WARNING cinder.volume.drivers.remotefs [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.info is being set with open permissions: ugo+rw Sep 30 19:57:59 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.info {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:58:00 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.info Sep 30 19:58:00 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:58:00 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.info" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:58:00 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-0e2b64f2-caf5-432c-ba32-bb2fc72063ac tempest-ProjectMemberTests-1043366750 None] Create snapshot completed successfully Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-3fc09d7c-1e86-43ab-ad59-f4779e48595d-delete_snapshot" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-3fc09d7c-1e86-43ab-ad59-f4779e48595d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-4037a29c-5a53-4f62-b9c8-8d3930008869" by "delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-4037a29c-5a53-4f62-b9c8-8d3930008869" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-3fc09d7c-1e86-43ab-ad59-f4779e48595d" by "_delete_snapshot" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-3fc09d7c-1e86-43ab-ad59-f4779e48595d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Deleting offline snapshot 3fc09d7c-1e86-43ab-ad59-f4779e48595d of volume 4037a29c-5a53-4f62-b9c8-8d3930008869 {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] snapshot_file for this snap is: volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d {{(pid=87426) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e54cd5-c4ed-48bd-9772-dbf95ecd43e7]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:58:00 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:58:00 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d Sep 30 19:58:00 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:58:01 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Sep 30 19:58:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d" returned: 0 in 0.358s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:58:01 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.remotefs [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4037a29c-5a53-4f62-b9c8-8d3930008869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87426) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 19:58:01 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dfc65d-f838-4008-b9ad-b580da144007]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:58:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:58:01 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 Sep 30 19:58:01 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:58:01 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Sep 30 19:58:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869" returned: 0 in 0.350s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:58:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:58:01 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d Sep 30 19:58:01 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:58:01 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Sep 30 19:58:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d" returned: 0 in 0.330s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:58:01 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:58:01 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d Sep 30 19:58:01 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:58:02 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869.3fc09d7c-1e86-43ab-ad59-f4779e48595d" returned: 0 in 0.249s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-3fc09d7c-1e86-43ab-ad59-f4779e48595d" released by "_delete_snapshot" :: held 1.383s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-4037a29c-5a53-4f62-b9c8-8d3930008869" released by "delete_snapshot" :: held 1.405s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Created reservations ['975b7848-ad50-4fa8-9d0f-d982c0880884', '600c8f13-0212-4688-96ea-7f77e0a15bee', 'e19f26ad-c93c-4ffd-9e96-6ef619353651', '59e5a892-14f8-4402-a3a2-8179ad767d4f'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:58:02 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Delete snapshot completed successfully. Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-a720e498-0632-4734-a156-afb354e272a3 tempest-ProjectMemberTests-1043366750 None] Lock "cinder-3fc09d7c-1e86-43ab-ad59-f4779e48595d-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-4037a29c-5a53-4f62-b9c8-8d3930008869-delete_volume" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Lock "cinder-4037a29c-5a53-4f62-b9c8-8d3930008869-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Acquiring lock "cinder-quobyte-4037a29c-5a53-4f62-b9c8-8d3930008869" by "delete_volume" {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-4037a29c-5a53-4f62-b9c8-8d3930008869" acquired by "delete_volume" :: waited 0.014s {{(pid=87426) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2447e2-8326-46e8-a074-ed885b2d9bdb]: (4, 'qcow2') {{(pid=89149) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 19:58:02 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:58:02 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 Sep 30 19:58:02 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:58:03 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869" returned: 0 in 0.363s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:58:03 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869 Sep 30 19:58:03 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:58:03 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947/volume-4037a29c-5a53-4f62-b9c8-8d3930008869" returned: 0 in 0.239s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Lock "cinder-quobyte-4037a29c-5a53-4f62-b9c8-8d3930008869" released by "delete_volume" :: held 0.665s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG cinder.quota [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Created reservations ['0cca4ea7-7063-4a79-b69f-7d26f6ee53ed', 'af8b7283-e8eb-4466-9a91-19f7337575bd', '1bcb9967-509b-4194-a9cd-75b8a9870c3c', '426da708-26b7-4898-903a-211e8b9cd993'] {{(pid=87426) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:58:03 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:58:03 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:58:03 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.241s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:58:03 devstack cinder-volume[87426]: INFO cinder.volume.manager [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Deleted volume successfully. Sep 30 19:58:03 devstack cinder-volume[87426]: DEBUG cinder.coordination [None req-fbeaf765-8d5e-4ae4-b4ee-607908c602ea tempest-ProjectMemberTests-1043366750 None] Lock "cinder-4037a29c-5a53-4f62-b9c8-8d3930008869-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87426) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 19:58:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:UPDATE=125,cinder:SELECT=100,cinder:INSERT=33,cinder:DELETE=11 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:58:19 devstack cinder-volume[87426]: DEBUG dbcounter [-] [87426] Writing DB stats cinder:SELECT=108,cinder:INSERT=40,cinder:UPDATE=146,cinder:DELETE=10 {{(pid=87426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 19:58:23 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:58:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 19:58:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 19:58:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217': None} {{(pid=87426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 19:58:23 devstack cinder-volume[87426]: DEBUG cinder.volume.drivers.quobyte [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b70f1c87-452c-48e8-9759-391885d9e217'] {{(pid=87426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 19:58:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.lockutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 19:58:23 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 19:58:23 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947 Sep 30 19:58:23 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 19:58:24 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Sep 30 19:58:24 devstack cinder-volume[87426]: DEBUG oslo_concurrency.processutils [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a4c10150fcc26d23b5aaa87f65460947" returned: 0 in 0.239s {{(pid=87426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 19:58:24 devstack cinder-volume[87426]: DEBUG cinder.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Notifying Schedulers of capabilities ... {{(pid=87426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 19:58:24 devstack cinder-volume[87426]: DEBUG oslo_service.periodic_task [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] Running periodic task VolumeManager._thread_info {{(pid=87426) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 19:58:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread count: 28 {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 19:58:24 devstack cinder-volume[87426]: DEBUG cinder.volume.manager [None req-93d186fb-c89d-4d46-bc62-275bd0f0f50a None None] thread info: [<_MainThread(MainThread, started 136599003316352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87426) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}